2017-10-11T04:02:44.370+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] MongoDB starting : pid=21210 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:02:44.377+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:02:44.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:02:44.833+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694564:833252][21210:0x7fb392bbdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:02:44.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:02:44.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb391aed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB391ACC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6823000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB3927A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB3925A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB3922A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB392091000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB391E74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB391ACC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB3929AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb391aed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:02:44.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:03:44.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] MongoDB starting : pid=21417 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:03:44.977+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:03:45.026+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:03:45.333+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694625:333629][21417:0x7f9e8c757c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:03:45.333+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:03:45.344+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e8b687635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E8B666000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA44FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E8C33E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E8C13A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E8BE40000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E8BC2B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E8BA0E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E8B666000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E8C547000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e8b687635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:03:45.344+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:04:44.465+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] MongoDB starting : pid=21625 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:04:44.473+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:04:44.524+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:04:44.854+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694684:853999][21625:0x7f9c23cffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:04:44.854+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:04:44.864+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c22c2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C22C0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA98F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C238E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C236E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C233E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C231D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C22FB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C22C0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C23AEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c22c2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:04:44.864+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:05:44.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=21754 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:05:44.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:05:44.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:05:45.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694745:3765][21754:0x7f37fbd85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:05:45.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:05:45.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37facb5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37FAC94000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37FB96C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37FB768000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F37FB46E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37FB259000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F37FB03C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37FAC94000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F37FBB75000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37facb5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:05:45.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:06:44.395+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] MongoDB starting : pid=22034 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:06:44.404+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:06:44.456+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:06:44.800+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694804:800259][22034:0x7f491d080c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:06:44.800+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:06:44.819+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f491bfb0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F491BF8F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF220FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F491CC67000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F491CA63000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F491C769000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F491C554000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F491C337000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F491BF8F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F491CE70000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f491bfb0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:06:44.819+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:07:44.955+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] MongoDB starting : pid=22293 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:07:44.962+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:07:45.012+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:07:45.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694865:291685][22293:0x7f6b6d95bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:07:45.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:07:45.302+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b6c88b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B6C86A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFD6B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B6D542000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B6D33E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B6D044000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B6CE2F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B6CC12000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B6C86A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B6D74B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b6c88b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:07:45.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:08:44.432+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] MongoDB starting : pid=22519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:08:44.440+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:08:44.490+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:08:44.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694924:846251][22519:0x7f7e2be2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:08:44.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:08:44.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e2ad5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E2AD3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBDCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E2BA13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E2B80F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E2B515000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E2B300000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E2B0E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E2AD3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E2BC1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e2ad5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:08:44.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:09:44.972+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=22730 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:09:44.979+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:09:45.029+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:09:45.358+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507694985:358688][22730:0x7fe64d045c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:09:45.358+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:09:45.378+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe64bf75635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE64BF54000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF83ABA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE64CC2C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE64CA28000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE64C72E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE64C519000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE64C2FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE64BF54000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE64CE35000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe64bf75635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:09:45.378+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:10:44.820+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=22856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:10:44.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:10:44.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:10:45.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695045:266735][22856:0x7fcbc82e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:10:45.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:10:45.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbc7211635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBC71F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FEA8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBC7EC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBC7CC4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBC79CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBC77B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBC7598000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBC71F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBC80D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbc7211635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:10:45.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:11:44.653+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] MongoDB starting : pid=23134 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:11:44.660+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:11:44.713+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:11:45.051+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695105:51522][23134:0x7f9c0a084c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:11:45.051+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:11:45.071+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c08fb4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C08F93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFAC11000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C09C6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C09A67000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C0976D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C09558000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C0933B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C08F93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C09E74000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c08fb4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:11:45.071+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:12:44.190+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] MongoDB starting : pid=23461 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:12:44.198+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:12:44.247+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:12:44.588+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695164:588897][23461:0x7ff9069c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:12:44.588+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:12:44.599+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9058f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9058D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B812000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF9065B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9063AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9060B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF905E9D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF905C80000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9058D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9067B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9058f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:12:44.599+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:13:44.720+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] MongoDB starting : pid=23692 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:13:44.727+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:13:44.777+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:13:45.145+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695225:145278][23692:0x7f4d4aedec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:13:45.145+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:13:45.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d49e0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D49DED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF162FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D4AAC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D4A8C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D4A5C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D4A3B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D4A195000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D49DED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D4ACCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d49e0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:13:45.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:14:44.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] MongoDB starting : pid=23902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:14:44.281+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:14:44.331+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:14:44.628+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695284:628206][23902:0x7f7ebe48cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:14:44.628+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:14:44.647+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ebd3bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EBD39B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF894FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EBE073000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EBDE6F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EBDB75000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EBD960000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EBD743000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EBD39B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EBE27C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ebd3bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:14:44.647+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:15:44.948+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=24018 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:15:44.958+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:15:45.014+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:15:45.311+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695345:311096][24018:0x7f8837f0cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:15:45.311+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:15:45.324+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8836e3c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8836E1B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8837AF3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88378EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88375F5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88373E0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88371C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8836E1B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8837CFC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8836e3c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:15:45.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:16:44.801+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=24332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:16:44.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:16:44.863+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:16:45.226+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695405:226681][24332:0x7f439e3b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:16:45.226+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:16:45.246+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f439d2e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F439D2C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F439DF99000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F439DD95000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F439DA9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F439D886000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F439D669000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F439D2C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F439E1A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f439d2e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:16:45.246+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:17:44.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] MongoDB starting : pid=24588 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:17:44.393+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:17:44.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:17:44.842+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695464:842674][24588:0x7f1950bd3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:17:44.842+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:17:44.861+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f194fb03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F194FAE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19507BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19505B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19502BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19500A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F194FE8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F194FAE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19509C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f194fb03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:17:44.862+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:18:44.974+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] MongoDB starting : pid=24808 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:18:44.981+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:18:45.031+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:18:45.290+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695525:290586][24808:0x7f36c3c70c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:18:45.290+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:18:45.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36c2ba0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36C2B7F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF168FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36C3857000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36C3653000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36C3359000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36C3144000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36C2F27000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36C2B7F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36C3A60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36c2ba0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:18:45.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:19:44.432+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] MongoDB starting : pid=25018 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:19:44.439+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:19:44.490+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:19:44.818+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695584:818461][25018:0x7f1080166c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:19:44.818+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:19:44.829+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f107f096635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F107F075000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F107FD4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F107FB49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F107F84F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F107F63A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F107F41D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F107F075000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F107FF56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f107f096635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:19:44.829+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:20:44.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] MongoDB starting : pid=25144 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:20:44.306+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:20:44.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:20:44.744+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695644:744336][25144:0x7fc4438e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:20:44.744+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:20:44.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc442816635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4427F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4434CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4432C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC442FCF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC442DBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC442B9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4427F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4436D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc442816635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:20:44.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:21:44.154+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] MongoDB starting : pid=25432 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:21:44.161+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:21:44.211+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:21:44.515+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695704:515018][25432:0x7fc2f6db7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:21:44.515+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:21:44.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc2f5ce7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC2F5CC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC2F699E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC2F679A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC2F64A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC2F628B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC2F606E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC2F5CC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC2F6BA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc2f5ce7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:21:44.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:22:44.647+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=25687 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:22:44.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:22:44.704+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:22:45.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695765:92075][25687:0x7f432eb64c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:22:45.092+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:22:45.112+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f432da94635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F432DA73000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86CA8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F432E74B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F432E547000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F432E24D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F432E038000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F432DE1B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F432DA73000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F432E954000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f432da94635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:22:45.112+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:23:44.263+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=25909 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:23:44.274+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:23:44.325+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:23:44.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695824:724899][25909:0x7f79a38fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:23:44.725+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:23:44.744+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f79a282b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79A280A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF33AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79A34E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79A32DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79A2FE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F79A2DCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79A2BB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79A280A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79A36EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f79a282b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:23:44.744+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:24:44.868+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] MongoDB starting : pid=26121 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:24:44.875+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:24:44.926+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:24:45.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695885:274639][26121:0x7f693228ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:24:45.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:24:45.294+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f69311ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6931199000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF918FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6931E71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6931C6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6931973000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F693175E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6931541000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6931199000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F693207A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f69311ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:24:45.294+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:25:44.347+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] MongoDB starting : pid=26246 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:25:44.351+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:25:44.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:25:44.734+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507695944:734865][26246:0x7fdba05e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:25:44.734+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:25:44.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb9f510635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB9F4EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF668FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDBA01C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB9FFC3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB9FCC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB9FAB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB9F897000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB9F4EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDBA03D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb9f510635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:25:44.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:26:44.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=26523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:26:44.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:26:44.196+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:26:44.565+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696004:565922][26523:0x7ff436182c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:26:44.565+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:26:44.576+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff4350b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF435091000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51CE8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF435D69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF435B65000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF43586B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF435656000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF435439000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF435091000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF435F72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff4350b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:26:44.576+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:27:44.701+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] MongoDB starting : pid=26768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:27:44.708+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:27:44.759+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:27:45.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696065:41637][26768:0x7f0413ea9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:27:45.041+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:27:45.061+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0412dd9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0412DB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A260000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0413A90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F041388C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0413592000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F041337D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0413160000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0412DB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0413C99000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0412dd9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:27:45.061+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:28:44.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] MongoDB starting : pid=27007 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:28:44.189+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:28:44.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:28:44.241+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:28:44.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696124:608219][27007:0x7f14174aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:28:44.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:28:44.627+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14163de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14163BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21BF2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1417095000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1416E91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1416B97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1416982000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1416765000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14163BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F141729E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14163de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:28:44.627+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:29:44.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=27214 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:29:44.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:29:44.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:29:45.166+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696185:166950][27214:0x7f5c5381cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:29:45.167+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:29:45.177+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c5274c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C5272B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF114FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C53403000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C531FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C52F05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C52CF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C52AD3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C5272B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C5360C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c5274c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:29:45.177+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:30:44.808+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=27330 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:30:44.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:30:44.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:30:45.122+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696245:122720][27330:0x7f6256899c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:30:45.122+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:30:45.133+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62557c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62557A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF354E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6256480000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F625627C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6255F82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6255D6D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6255B50000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62557A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6256689000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62557c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:30:45.133+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:31:44.595+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=27602 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:31:44.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:31:44.653+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:31:45.016+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696305:16761][27602:0x7f6e37b59c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:31:45.016+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:31:45.027+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e36a89635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E36A68000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAF431000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E37740000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E3753C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E37242000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E3702D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E36E10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E36A68000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E37949000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e36a89635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:31:45.027+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:32:44.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] MongoDB starting : pid=27836 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:32:44.189+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:32:44.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:32:44.592+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696364:592740][27836:0x7fa9c78c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:32:44.592+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:32:44.605+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9c67f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9C67CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDCA5D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9C74A7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9C72A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9C6FA9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9C6D94000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9C6B77000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9C67CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9C76B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9c67f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:32:44.605+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:33:44.738+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] MongoDB starting : pid=28089 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:33:44.746+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:33:44.797+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:33:45.130+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696425:130558][28089:0x7feab60dac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:33:45.130+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:33:45.141+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feab500a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEAB4FE9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8EC2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEAB5CC1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEAB5ABD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEAB57C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEAB55AE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEAB5391000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEAB4FE9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEAB5ECA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feab500a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:33:45.141+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:34:44.261+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] MongoDB starting : pid=28245 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:34:44.268+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:34:44.269+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:34:44.318+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:34:44.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696484:643780][28245:0x7f0650f86c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:34:44.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:34:44.654+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f064feb6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F064FE95000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0650B6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0650969000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F065066F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F065045A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F065023D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F064FE95000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0650D76000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f064feb6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:34:44.654+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:35:44.840+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] MongoDB starting : pid=28415 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:35:44.846+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:35:44.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:35:45.151+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696545:151007][28415:0x7f24afdfac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:35:45.151+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:35:45.161+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24aed2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24AED09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD7EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F24AF9E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F24AF7DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F24AF4E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F24AF2CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F24AF0B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24AED09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24AFBEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24aed2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:35:45.161+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:36:44.643+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] MongoDB starting : pid=28546 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:36:44.650+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:36:44.699+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:36:45.060+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696605:60317][28546:0x7f4d4efffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:36:45.060+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:36:45.080+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d4df2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D4DF0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D4EBE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D4E9E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D4E6E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D4E4D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D4E2B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D4DF0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D4EDEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d4df2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:36:45.080+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:37:44.201+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] MongoDB starting : pid=28826 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:37:44.209+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:37:44.265+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:37:44.677+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696664:677950][28826:0x7f3d9e4dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:37:44.678+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:37:44.697+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d9d40e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D9D3ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D9E0C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D9DEC1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D9DBC7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D9D9B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D9D795000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D9D3ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D9E2CE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d9d40e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:37:44.697+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:38:44.827+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=29076 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:38:44.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:38:44.884+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:38:45.239+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696725:239317][29076:0x7fde0471bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:38:45.239+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:38:45.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde0364b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE0362A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1A42D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE04302000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE040FE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE03E04000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE03BEF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE039D2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE0362A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE0450B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde0364b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:38:45.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:39:44.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] MongoDB starting : pid=29272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:39:44.382+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:39:44.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:39:44.767+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696784:767141][29272:0x7fbeec7edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:39:44.767+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:39:44.777+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbeeb71d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBEEB6FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1885A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBEEC3D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBEEC1D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBEEBED6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBEEBCC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBEEBAA4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBEEB6FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBEEC5DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbeeb71d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:39:44.777+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:40:44.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=29481 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:40:44.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:40:44.173+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:40:44.441+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696844:441211][29481:0x7f722b4f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:40:44.441+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:40:44.452+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f722a424635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F722A403000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F722B0DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F722AED7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F722ABDD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F722A9C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F722A7AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F722A403000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F722B2E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f722a424635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:40:44.452+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:41:44.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] MongoDB starting : pid=29619 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:41:44.823+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:41:44.873+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:41:45.284+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696905:284016][29619:0x7f1108e9bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:41:45.284+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:41:45.295+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1107dcb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1107DAA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA7AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1108A82000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F110887E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1108584000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F110836F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1108152000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1107DAA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1108C8B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1107dcb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:41:45.295+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:42:44.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=29899 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:42:44.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:42:44.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:42:44.769+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507696964:769220][29899:0x7f3d8a1fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:42:44.769+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:42:44.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d8912a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D89109000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D89DE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D89BDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D898E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D896CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D894B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D89109000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D89FEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d8912a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:42:44.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:43:44.912+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] MongoDB starting : pid=30152 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:43:44.920+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:43:44.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:43:45.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697025:318849][30152:0x7ff840abec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:43:45.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:43:45.329+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff83f9ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF83F9CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8406A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8404A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8401A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF83FF92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF83FD75000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF83F9CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF8408AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff83f9ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:43:45.329+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:44:44.453+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=30361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:44:44.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:44:44.511+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:44:44.798+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697084:798947][30361:0x7fac7c22bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:44:44.799+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:44:44.820+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac7b15b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC7B13A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6CEA2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC7BE12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC7BC0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC7B914000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC7B6FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC7B4E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC7B13A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC7C01B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac7b15b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:44:44.820+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:45:44.314+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=30571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:45:44.322+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:45:44.372+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:45:44.762+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697144:762501][30571:0x7ffa28ae5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:45:44.762+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:45:44.782+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa27a15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA279F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDDCBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA286CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA284C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA281CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA27FB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA27D9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA279F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA288D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa27a15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:45:44.782+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:46:44.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=30710 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:46:44.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:46:44.229+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:46:44.591+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697204:591773][30710:0x7f09c5e8bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:46:44.591+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:46:44.602+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09c4dbb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09C4D9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF749D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09C5A72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09C586E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09C5574000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09C535F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09C5142000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09C4D9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09C5C7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09c4dbb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:46:44.602+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:47:44.730+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] MongoDB starting : pid=30994 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:47:44.737+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:47:44.786+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:47:45.120+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697265:120823][30994:0x7f4079639c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:47:45.120+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:47:45.140+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4078569635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4078548000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4079220000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F407901C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4078D22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4078B0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40788F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4078548000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4079429000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4078569635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:47:45.140+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:48:44.266+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] MongoDB starting : pid=31231 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:48:44.273+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:48:44.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:48:44.637+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697324:637320][31231:0x7f68340dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:48:44.637+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:48:44.647+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f683300e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6832FED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF590FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6833CC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6833AC1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68337C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68335B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6833395000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6832FED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6833ECE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f683300e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:48:44.647+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:49:44.774+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=31429 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:49:44.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:49:44.832+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:49:45.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697385:243156][31429:0x7f7336df0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:49:45.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:49:45.263+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7335d20635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7335CFF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F73369D7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F73367D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F73364D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73362C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73360A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7335CFF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7336BE0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7335d20635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:49:45.263+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:50:44.609+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] MongoDB starting : pid=31648 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:50:44.616+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:50:44.666+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:50:45.007+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697445:7633][31648:0x7fb4cc2f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:50:45.007+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:50:45.019+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb4cb226635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB4CB205000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95094000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB4CBEDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB4CBCD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB4CB9DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB4CB7CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB4CB5AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB4CB205000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB4CC0E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb4cb226635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:50:45.019+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:51:44.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=31779 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:51:44.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:51:44.485+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:51:44.797+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697504:797552][31779:0x7fa6349eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:51:44.797+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:51:44.808+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa63391a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6338F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFF8B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6345D1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6343CD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6340D3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA633EBE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA633CA1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6338F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6347DA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa63391a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:51:44.808+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:52:44.938+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:52:44.945+0000 I CONTROL [initandlisten] MongoDB starting : pid=32055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:52:44.946+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:52:44.996+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:52:45.381+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697565:381646][32055:0x7f0fd8f98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:52:45.381+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:52:45.400+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fd7ec8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FD7EA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB46FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FD8B7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FD897B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FD8681000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FD846C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FD824F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FD7EA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FD8D88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fd7ec8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:52:45.400+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:53:44.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:53:44.541+0000 I CONTROL [initandlisten] MongoDB starting : pid=32291 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:53:44.542+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:53:44.594+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:53:44.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697624:915768][32291:0x7f1711e9ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:53:44.915+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:53:44.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1710dce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1710DAD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42E24000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1711A85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1711881000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1711587000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1711372000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1711155000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1710DAD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1711C8E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1710dce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:53:44.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:54:44.061+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] MongoDB starting : pid=32500 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:54:44.068+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:54:44.118+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:54:44.466+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697684:466799][32500:0x7f333116ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:54:44.466+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:54:44.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f333009e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F333007D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3330D55000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3330B51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3330857000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3330642000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3330425000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F333007D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3330F5E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f333009e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:54:44.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:55:44.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=32709 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:55:44.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:55:44.198+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:55:44.616+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697744:616612][32709:0x7f7312351c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:55:44.616+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:55:44.636+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7311281635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7311260000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1D0ED000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7311F38000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7311D34000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7311A3A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7311825000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7311608000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7311260000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7312141000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7311281635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:55:44.636+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:56:44.110+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] MongoDB starting : pid=382 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:56:44.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:56:44.167+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:56:44.468+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697804:468645][382:0x7f25a1addc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:56:44.468+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:56:44.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25a0a0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25A09EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC72FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25A16C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F25A14C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25A11C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25A0FB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25A0D94000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25A09EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25A18CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25a0a0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:56:44.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:57:44.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:57:44.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=659 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:57:44.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:57:44.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:57:44.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:57:44.601+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:57:44.602+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:57:44.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:57:44.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:57:44.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:57:44.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:57:45.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697865:50531][659:0x7f9e5fa33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:57:45.050+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:57:45.069+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e5e963635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E5E942000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F2E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E5F61A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E5F416000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E5F11C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E5EF07000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E5ECEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E5E942000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E5F823000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e5e963635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:57:45.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:58:44.202+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] MongoDB starting : pid=912 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:58:44.209+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:58:44.259+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:58:44.648+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697924:648815][912:0x7f8378befc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:58:44.648+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:58:44.668+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8377b1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8377AFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83787D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83785D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83782D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83780C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8377EA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8377AFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83789DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8377b1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:58:44.668+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T04:59:44.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=1120 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] modules: none 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] build environment: 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T04:59:44.798+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T04:59:44.848+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T04:59:45.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507697985:158064][1120:0x7f249cb94c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T04:59:45.158+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T04:59:45.168+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f249bac4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F249BAA3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF87AEB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F249C77B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F249C577000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F249C27D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F249C068000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F249BE4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F249BAA3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F249C984000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f249bac4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T04:59:45.168+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:00:44.422+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] MongoDB starting : pid=1336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:00:44.430+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:00:44.480+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:00:44.789+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698044:789347][1336:0x7ffbc53e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:00:44.789+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:00:44.799+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffbc4313635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBC42F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF560FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBC4FCA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBC4DC6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBC4ACC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBC48B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBC469A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBC42F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBC51D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffbc4313635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:00:44.799+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:01:44.190+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] MongoDB starting : pid=1470 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:01:44.197+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:01:44.247+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:01:44.542+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698104:542096][1470:0x7fe4c0c90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:01:44.542+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:01:44.552+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4bfbc0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4BFB9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4C0877000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4C0673000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4C0379000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4C0164000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4BFF47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4BFB9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4C0A80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4bfbc0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:01:44.552+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:02:44.965+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] MongoDB starting : pid=1765 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:02:44.972+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:02:45.021+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:02:45.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698165:287396][1765:0x7fef04679c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:02:45.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:02:45.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef035a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF03588000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9742E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF04260000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF0405C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF03D62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF03B4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF03930000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF03588000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF04469000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef035a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:02:45.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:03:44.432+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] MongoDB starting : pid=2003 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:03:44.439+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:03:44.491+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:03:44.793+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698224:793463][2003:0x7fdd761edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:03:44.793+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:03:44.804+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd7511d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD750FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF490FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD75DD4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD75BD0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD758D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD756C1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD754A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD750FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD75FDD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd7511d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:03:44.804+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:04:44.930+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] MongoDB starting : pid=2211 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:04:44.938+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:04:44.988+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:04:45.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698285:370245][2211:0x7f44550b1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:04:45.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:04:45.390+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4453fe1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4453FC0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3AA54000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4454C98000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4454A94000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F445479A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4454585000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4454368000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4453FC0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4454EA1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4453fe1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:04:45.390+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:05:44.511+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] MongoDB starting : pid=2411 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:05:44.520+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:05:44.571+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:05:44.905+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698344:905833][2411:0x7f2793af5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:05:44.905+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:05:44.917+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2792a25635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2792A04000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF807C5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27936DC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27934D8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F27931DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2792FC9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2792DAC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2792A04000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27938E5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2792a25635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:05:44.917+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:06:44.078+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] MongoDB starting : pid=2533 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:06:44.085+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:06:44.134+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:06:44.535+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698404:534991][2533:0x7fc07bc3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:06:44.535+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:06:44.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc07ab6b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC07AB4A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC07B822000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC07B61E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC07B324000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC07B10F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC07AEF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC07AB4A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC07BA2B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc07ab6b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:06:44.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:07:44.683+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:07:44.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=2828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:07:44.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:07:44.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:07:44.691+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:07:44.691+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:07:44.691+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:07:44.691+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:07:44.691+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:07:44.691+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:07:44.740+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:07:45.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698465:52528][2828:0x7f22c1f53c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:07:45.052+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:07:45.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22c0e83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22C0E62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBDEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22C1B3A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22C1936000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22C163C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22C1427000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22C120A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22C0E62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22C1D43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22c0e83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:07:45.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:08:44.189+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] MongoDB starting : pid=3078 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:08:44.197+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:08:44.247+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:08:44.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698524:559018][3078:0x7fe88bb50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:08:44.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:08:44.570+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe88aa80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE88AA5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE88B737000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE88B533000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE88B239000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE88B024000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE88AE07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE88AA5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE88B940000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe88aa80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:08:44.570+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:09:44.692+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] MongoDB starting : pid=3288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:09:44.699+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:09:44.749+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:09:45.063+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698585:63508][3288:0x7f7f45570c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:09:45.063+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:09:45.074+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f444a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F4447F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F45157000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F44F53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F44C59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F44A44000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F44827000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F4447F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F45360000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f444a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:09:45.074+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:10:44.197+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] MongoDB starting : pid=3480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:10:44.205+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:10:44.254+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:10:44.615+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698644:615068][3480:0x7f04b9aafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:10:44.615+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:10:44.632+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04b89df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04B89BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF45AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04B9696000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04B9492000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04B9198000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04B8F83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04B8D66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04B89BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04B989F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04b89df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:10:44.632+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:11:44.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] MongoDB starting : pid=3626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:11:44.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:11:44.532+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:11:44.875+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698704:875099][3626:0x7f667671ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:11:44.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:11:44.885+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f667564e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F667562D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6676305000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6676101000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6675E07000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6675BF2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F66759D5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F667562D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F667650E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f667564e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:11:44.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:12:45.002+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] MongoDB starting : pid=3781 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:12:45.009+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:12:45.060+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:12:45.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698765:395610][3781:0x7fdcd0432c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:12:45.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:12:45.408+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdccf362635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCCF341000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF106F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCD0019000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCCFE15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCCFB1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCCF906000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCCF6E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCCF341000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCD0222000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdccf362635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:12:45.408+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:13:44.518+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] MongoDB starting : pid=4091 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:13:44.526+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:13:44.576+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:13:44.945+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698824:945947][4091:0x7ff44f0d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:13:44.946+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:13:44.956+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff44e007635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF44DFE6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEADD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF44ECBE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF44EABA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF44E7C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF44E5AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF44E38E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF44DFE6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF44EEC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff44e007635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:13:44.956+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:14:44.075+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=4291 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:14:44.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:14:44.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:14:44.488+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698884:488008][4291:0x7f15e0a1ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:14:44.488+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:14:44.508+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15df94a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15DF929000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15E0601000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15E03FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15E0103000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15DFEEE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15DFCD1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15DF929000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15E080A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15df94a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:14:44.508+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:15:44.626+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] MongoDB starting : pid=4502 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:15:44.633+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:15:44.683+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:15:44.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507698944:963440][4502:0x7ffc0138ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:15:44.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:15:44.974+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc002be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC0029D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5DB4A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC00F75000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC00D71000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC00A77000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC00862000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC00645000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC0029D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC0117E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc002be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:15:44.974+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:16:44.742+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] MongoDB starting : pid=4720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:16:44.749+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:16:44.801+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:16:45.144+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699005:144594][4720:0x7f29284d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:16:45.144+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:16:45.155+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2927401635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29273E0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29280B8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2927EB4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2927BBA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29279A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2927788000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29273E0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29282C1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2927401635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:16:45.155+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:17:44.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] MongoDB starting : pid=4875 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:17:44.281+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:17:44.330+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:17:44.685+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699064:685916][4875:0x7fe195428c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:17:44.685+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:17:44.696+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe194358635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE194337000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE19500F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE194E0B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE194B11000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1948FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1946DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE194337000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE195218000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe194358635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:17:44.696+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:18:44.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] MongoDB starting : pid=5380 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:18:44.829+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:18:44.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:18:45.189+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699125:189527][5380:0x7f5891fb5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:18:45.189+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:18:45.200+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5890ee5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5890EC4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF06FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5891B9C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5891998000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F589169E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5891489000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F589126C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5890EC4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5891DA5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5890ee5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:18:45.200+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:19:44.330+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:19:44.337+0000 I CONTROL [initandlisten] MongoDB starting : pid=5702 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:19:44.337+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:19:44.338+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:19:44.387+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:19:44.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699184:751467][5702:0x7f9eaf8f0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:19:44.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:19:44.762+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9eae820635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9EAE7FF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF27BE8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9EAF4D7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9EAF2D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9EAEFD9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9EAEDC4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9EAEBA7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9EAE7FF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9EAF6E0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9eae820635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:19:44.762+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:20:44.889+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] MongoDB starting : pid=6070 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:20:44.897+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:20:44.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:20:45.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699245:240791][6070:0x7f18a333cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:20:45.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:20:45.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18a226c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18A224B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DCEC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18A2F23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18A2D1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18A2A25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18A2810000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18A25F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18A224B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18A312C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18a226c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:20:45.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:21:44.869+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] MongoDB starting : pid=6376 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:21:44.876+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:21:44.927+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:21:45.281+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699305:281499][6376:0x7f8c9cedac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:21:45.281+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:21:45.300+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8c9be0a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8C9BDE9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF236FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8C9CAC1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8C9C8BD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8C9C5C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8C9C3AE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8C9C191000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8C9BDE9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8C9CCCA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8c9be0a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:21:45.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:22:44.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] MongoDB starting : pid=6585 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:22:44.430+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:22:44.483+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:22:44.878+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699364:878586][6585:0x7f723d947c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:22:44.878+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:22:44.898+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f723c877635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F723C856000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F723D52E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F723D32A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F723D030000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F723CE1B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F723CBFE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F723C856000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F723D737000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f723c877635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:22:44.898+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:23:45.018+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] MongoDB starting : pid=6906 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:23:45.025+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:23:45.075+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:23:45.451+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699425:451000][6906:0x7f096fc61c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:23:45.451+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:23:45.470+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f096eb91635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F096EB70000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D86F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F096F848000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F096F644000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F096F34A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F096F135000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F096EF18000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F096EB70000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F096FA51000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f096eb91635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:23:45.470+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:24:44.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] MongoDB starting : pid=7107 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:24:44.610+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:24:44.661+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:24:45.007+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699485:7357][7107:0x7f65a6c66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:24:45.007+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:24:45.018+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65a5b96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65A5B75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6682D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65A684D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65A6649000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65A634F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65A613A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65A5F1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65A5B75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65A6A56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65a5b96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:24:45.018+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:25:44.148+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] MongoDB starting : pid=7329 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:25:44.155+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:25:44.205+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:25:44.504+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699544:504359][7329:0x7f1071b6ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:25:44.504+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:25:44.523+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1070a9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1070A7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1071755000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1071551000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1071257000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1071042000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1070E25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1070A7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F107195E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1070a9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:25:44.523+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:26:44.991+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=7539 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:26:44.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:26:44.999+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:26:45.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:26:45.363+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699605:363590][7539:0x7fd7a565dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:26:45.363+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:26:45.374+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7a458d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7A456C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF143D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7A5244000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7A5040000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7A4D46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7A4B31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7A4914000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7A456C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7A544D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7a458d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:26:45.374+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:27:44.502+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] MongoDB starting : pid=7695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:27:44.509+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:27:44.559+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:27:44.853+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699664:853571][7695:0x7f92a5c19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:27:44.853+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:27:44.864+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f92a4b49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F92A4B28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF746B5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F92A5800000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F92A55FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F92A5302000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F92A50ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F92A4ED0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F92A4B28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F92A5A09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f92a4b49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:27:44.864+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:28:44.998+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] MongoDB starting : pid=7996 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:28:45.005+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:28:45.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:28:45.462+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699725:462747][7996:0x7fa92119fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:28:45.462+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:28:45.482+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9200cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9200AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF252FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA920D86000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA920B82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA920888000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA920673000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA920456000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9200AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA920F8F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9200cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:28:45.482+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:29:44.610+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:29:44.617+0000 I CONTROL [initandlisten] MongoDB starting : pid=8196 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:29:44.618+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:29:44.667+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:29:44.968+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699784:968072][8196:0x7f3c5c8bfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:29:44.968+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:29:44.978+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c5b7ef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C5B7CE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C5C4A6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C5C2A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C5BFA8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C5BD93000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C5BB76000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C5B7CE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C5C6AF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c5b7ef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:29:44.978+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:30:44.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=8404 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:30:44.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:30:44.154+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:30:44.470+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699844:470899][8404:0x7f271d658c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:30:44.471+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:30:44.492+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f271c588635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F271C567000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA84FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F271D23F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F271D03B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F271CD41000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F271CB2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F271C90F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F271C567000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F271D448000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f271c588635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:30:44.492+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:31:44.948+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] MongoDB starting : pid=8625 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:31:44.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:31:45.007+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:31:45.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699905:338662][8625:0x7f65ce67cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:31:45.338+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:31:45.349+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65cd5ac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65CD58B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E427000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65CE263000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65CE05F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65CDD65000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65CDB50000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65CD933000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65CD58B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65CE46C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65cd5ac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:31:45.349+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:32:44.485+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] MongoDB starting : pid=8767 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:32:44.493+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:32:44.543+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:32:44.856+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507699964:856236][8767:0x7f3f6bde2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:32:44.856+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:32:44.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f6ad12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F6ACF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F6B9C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F6B7C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F6B4CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F6B2B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F6B099000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F6ACF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F6BBD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f6ad12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:32:44.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:33:44.991+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] MongoDB starting : pid=9061 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:33:45.008+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:33:45.058+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:33:45.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700025:408944][9061:0x7f1a749aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:33:45.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:33:45.419+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a738da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A738B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA8C8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A74591000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A7438D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A74093000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A73E7E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A73C61000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A738B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A7479A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a738da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:33:45.420+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:34:44.540+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] MongoDB starting : pid=9263 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:34:44.548+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:34:44.599+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:34:44.965+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700084:965776][9263:0x7f299e905c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:34:44.965+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:34:44.978+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f299d835635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F299D814000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB54FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F299E4EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F299E2E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F299DFEE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F299DDD9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F299DBBC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F299D814000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F299E6F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f299d835635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:34:44.978+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:35:44.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=9460 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:35:44.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:35:44.155+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:35:44.521+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700144:521042][9460:0x7f79df245c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:35:44.521+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:35:44.531+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f79de175635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79DE154000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAEC9C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79DEE2C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79DEC28000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79DE92E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F79DE719000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79DE4FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79DE154000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79DF035000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f79de175635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:35:44.531+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:36:44.226+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] MongoDB starting : pid=9670 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:36:44.233+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:36:44.283+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:36:44.589+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700204:589574][9670:0x7fa1d1420c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:36:44.589+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:36:44.608+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1d0350635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1D032F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF672FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1D1007000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1D0E03000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1D0B09000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1D08F4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1D06D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1D032F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1D1210000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1d0350635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:36:44.609+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:37:44.731+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] MongoDB starting : pid=9808 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:37:44.738+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:37:44.788+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:37:45.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700265:92920][9808:0x7f5c67b73c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:37:45.092+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:37:45.103+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c66aa3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C66A82000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C6775A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C67556000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C6725C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C67047000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C66E2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C66A82000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C67963000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c66aa3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:37:45.103+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:38:44.227+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:38:44.234+0000 I CONTROL [initandlisten] MongoDB starting : pid=10119 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:38:44.234+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:38:44.234+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:38:44.234+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:38:44.234+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:38:44.234+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:38:44.235+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:38:44.235+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:38:44.235+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:38:44.284+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:38:44.593+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700324:593753][10119:0x7f096c653c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:38:44.593+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:38:44.613+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f096b583635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F096B562000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDCEDE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F096C23A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F096C036000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F096BD3C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F096BB27000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F096B90A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F096B562000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F096C443000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f096b583635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:38:44.613+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:39:44.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] MongoDB starting : pid=10319 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:39:44.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:39:44.808+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:39:45.180+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700385:180892][10319:0x7f3f9ef09c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:39:45.180+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:39:45.201+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f9de39635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F9DE18000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F9EAF0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F9E8EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F9E5F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F9E3DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F9E1C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F9DE18000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F9ECF9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f9de39635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:39:45.201+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:40:44.329+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:40:44.336+0000 I CONTROL [initandlisten] MongoDB starting : pid=10522 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:40:44.336+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:40:44.336+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:40:44.336+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:40:44.336+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:40:44.336+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:40:44.337+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:40:44.337+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:40:44.337+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:40:44.387+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:40:44.687+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700444:687013][10522:0x7f87ba28bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:40:44.687+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:40:44.698+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f87b91bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87B919A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F87B9E72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F87B9C6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F87B9974000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F87B975F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F87B9542000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87B919A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87BA07B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f87b91bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:40:44.699+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:41:44.459+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] MongoDB starting : pid=10732 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:41:44.466+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:41:44.516+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:41:44.785+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700504:785858][10732:0x7fbbea47ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:41:44.785+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:41:44.796+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbbe93ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBBE938D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9EDE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBBEA065000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBBE9E61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBBE9B67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBBE9952000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBBE9735000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBBE938D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBBEA26E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbbe93ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:41:44.796+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:42:44.919+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] MongoDB starting : pid=10887 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:42:44.926+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:42:44.977+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:42:45.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700565:291074][10887:0x7fa66684fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:42:45.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:42:45.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa66577f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA66575E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA666436000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA666232000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA665F38000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA665D23000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA665B06000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA66575E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA66663F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa66577f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:42:45.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:43:44.428+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] MongoDB starting : pid=11187 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:43:44.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:43:44.486+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:43:44.833+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700624:833590][11187:0x7f4f15aa8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:43:44.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:43:44.845+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4f149d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4F149B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4F1568F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4F1548B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4F15191000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4F14F7C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4F14D5F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4F149B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4F15898000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4f149d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:43:44.845+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:44:44.967+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] MongoDB starting : pid=11388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:44:44.974+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:44:45.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:44:45.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700685:287955][11388:0x7fe82cd56c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:44:45.288+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:44:45.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe82bc86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE82BC65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF908FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE82C93D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE82C739000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE82C43F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE82C22A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE82C00D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE82BC65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE82CB46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe82bc86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:44:45.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:45:44.412+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] MongoDB starting : pid=11585 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:45:44.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:45:44.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:45:44.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700744:724141][11585:0x7fea932bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:45:44.724+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:45:44.734+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea921ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA921C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF59CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA92EA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA92C9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA929A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA9278E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA92571000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA921C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA930AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea921ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:45:44.734+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:46:44.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] MongoDB starting : pid=11793 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:46:44.722+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:46:44.771+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:46:45.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700805:41940][11793:0x7f5e4c6f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:46:45.042+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:46:45.052+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e4b623635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E4B602000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E4C2DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E4C0D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E4BDDC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E4BBC7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E4B9AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E4B602000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E4C4E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e4b623635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:46:45.052+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:47:44.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=11918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:47:44.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:47:44.234+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:47:44.540+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700864:540660][11918:0x7f9d679f8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:47:44.540+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:47:44.559+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d66928635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D66907000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF50EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D675DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D673DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D670E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D66ECC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D66CAF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D66907000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D677E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d66928635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:47:44.560+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:48:44.698+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] MongoDB starting : pid=12086 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:48:44.706+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:48:44.760+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:48:45.101+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700925:101087][12086:0x7f098a89bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:48:45.101+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:48:45.121+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09897cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09897AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF22FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F098A482000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F098A27E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0989F84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0989D6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0989B52000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09897AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F098A68B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09897cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:48:45.121+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:49:44.241+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=12349 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:49:44.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:49:44.298+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:49:44.602+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507700984:602868][12349:0x7feb057ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:49:44.602+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:49:44.613+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb0472f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB0470E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF474FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB053E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB051E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB04EE8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB04CD3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB04AB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB0470E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB055EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb0472f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:49:44.613+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:50:44.735+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] MongoDB starting : pid=12551 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:50:44.742+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:50:44.743+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:50:44.792+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:50:45.113+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701045:113235][12551:0x7fda2dd48c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:50:45.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:50:45.123+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda2cc78635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA2CC57000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA2D92F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA2D72B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA2D431000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA2D21C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA2CFFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA2CC57000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA2DB38000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda2cc78635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:50:45.123+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:51:44.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:51:44.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=12765 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:51:44.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:51:44.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:51:44.095+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:51:44.095+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:51:44.095+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:51:44.095+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:51:44.095+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:51:44.095+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:51:44.145+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:51:44.421+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701104:420994][12765:0x7ff341295c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:51:44.421+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:51:44.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3401c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3401A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF27F22000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF340E7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF340C78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF34097E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF340769000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF34054C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3401A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF341085000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3401c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:51:44.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:52:44.555+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] MongoDB starting : pid=12986 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:52:44.563+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:52:44.613+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:52:44.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701164:896338][12986:0x7f0cdb233c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:52:44.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:52:44.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0cda163635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CDA142000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CDAE1A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CDAC16000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CDA91C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CDA707000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CDA4EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CDA142000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CDB023000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0cda163635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:52:44.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:53:45.038+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] MongoDB starting : pid=13148 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:53:45.046+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:53:45.095+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:53:45.500+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701225:500002][13148:0x7f34c5160c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:53:45.500+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:53:45.519+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f34c4090635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F34C406F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF292D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F34C4D47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34C4B43000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34C4849000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F34C4634000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F34C4417000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34C406F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34C4F50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f34c4090635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:53:45.519+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:54:44.650+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] MongoDB starting : pid=13403 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:54:44.657+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:54:44.707+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:54:45.108+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701285:108895][13403:0x7fcfd2436c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:54:45.109+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:54:45.128+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcfd1366635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCFD1345000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9E30000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFD201D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFD1E19000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFD1B1F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFD190A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFD16ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCFD1345000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFD2226000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcfd1366635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:54:45.128+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:55:44.250+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] MongoDB starting : pid=13610 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:55:44.258+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:55:44.307+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:55:44.635+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701344:635429][13610:0x7fa907fc8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:55:44.635+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:55:44.646+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa906ef8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA906ED7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA907BAF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9079AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9076B1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA90749C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA90727F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA906ED7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA907DB8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa906ef8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:55:44.646+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:56:44.173+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=13824 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:56:44.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:56:44.211+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:56:44.525+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701404:525147][13824:0x7fc5b5ea4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:56:44.525+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:56:44.544+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc5b4dd4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC5B4DB3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38396000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC5B5A8B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC5B5887000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC5B558D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC5B5378000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC5B515B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC5B4DB3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC5B5C94000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc5b4dd4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:56:44.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:57:44.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:57:44.675+0000 I CONTROL [initandlisten] MongoDB starting : pid=14046 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:57:44.676+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:57:44.739+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:57:45.133+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701465:133561][14046:0x7f4973297c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:57:45.133+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:57:45.144+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f49721c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F49721A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF974FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4972E7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4972C7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4972980000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F497276B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F497254E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F49721A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4973087000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f49721c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:57:45.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:58:44.262+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] MongoDB starting : pid=14217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:58:44.269+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:58:44.319+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:58:44.625+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701524:625082][14217:0x7f40a3bacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:58:44.625+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:58:44.635+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40a2adc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40A2ABB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54EBC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40A3793000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40A358F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40A3295000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40A3080000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40A2E63000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40A2ABB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40A399C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40a2adc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:58:44.635+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T05:59:44.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] MongoDB starting : pid=14725 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] modules: none 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] build environment: 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T05:59:44.771+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T05:59:44.821+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T05:59:45.135+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701585:135712][14725:0x7fcdf277bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T05:59:45.135+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T05:59:45.146+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcdf16ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCDF168A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF832FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCDF2362000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCDF215E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCDF1E64000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCDF1C4F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCDF1A32000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCDF168A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCDF256B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcdf16ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T05:59:45.146+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:00:44.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] MongoDB starting : pid=15087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:00:44.427+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:00:44.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:00:44.835+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701644:835589][15087:0x7f22b19d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:00:44.835+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:00:44.846+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22b0908635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22B08E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F22B22E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22B15BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22B13BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22B10C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22B0EAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22B0C8F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22B08E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22B17C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22b0908635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:00:44.846+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:01:44.506+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] MongoDB starting : pid=15300 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:01:44.514+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:01:44.564+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:01:44.881+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701704:881191][15300:0x7fbbcebefc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:01:44.881+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:01:44.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbbcdb1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBBCDAFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBBCE7D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBBCE5D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBBCE2D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBBCE0C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBBCDEA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBBCDAFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBBCE9DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbbcdb1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:01:44.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:02:44.642+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] MongoDB starting : pid=15534 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:02:44.649+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:02:44.699+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:02:45.039+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701765:39669][15534:0x7fabbef33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:02:45.039+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:02:45.059+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabbde63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABBDE42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86CEF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABBEB1A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABBE916000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABBE61C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABBE407000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABBE1EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABBDE42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABBED23000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabbde63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:02:45.059+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:03:44.179+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] MongoDB starting : pid=15701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:03:44.186+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:03:44.237+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:03:44.585+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701824:585018][15701:0x7f2f0e826c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:03:44.585+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:03:44.595+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f0d756635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F0D735000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F0E40D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F0E209000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F0DF0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F0DCFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F0DADD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F0D735000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F0E616000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f0d756635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:03:44.595+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:04:44.718+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=15964 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:04:44.726+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:04:44.778+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:04:45.185+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701885:185577][15964:0x7f4e1ad60c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:04:45.185+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:04:45.205+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e19c90635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E19C6F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF576BA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E1A947000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E1A743000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E1A449000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E1A234000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E1A017000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E19C6F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E1AB50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e19c90635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:04:45.205+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:05:44.326+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] MongoDB starting : pid=16166 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:05:44.334+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:05:44.386+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:05:44.793+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507701944:793368][16166:0x7eff2345dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:05:44.793+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:05:44.813+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff2238d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF2236C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF380FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF23044000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF22E40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF22B46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF22931000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF22714000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF2236C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF2324D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff2238d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:05:44.813+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:06:44.906+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=16381 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:06:44.913+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:06:44.962+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:06:45.360+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702005:360955][16381:0x7fccec490c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:06:45.361+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:06:45.380+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcceb3c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCEB39F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCEC077000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCEBE73000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCEBB79000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCEB964000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCEB747000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCEB39F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCEC280000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcceb3c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:06:45.380+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:07:44.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] MongoDB starting : pid=16609 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:07:44.506+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:07:44.556+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:07:44.823+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702064:823921][16609:0x7f6c0b29ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:07:44.823+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:07:44.834+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6c0a1ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6C0A1AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C0AE85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C0AC81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C0A987000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C0A772000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6C0A555000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6C0A1AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C0B08E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6c0a1ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:07:44.834+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:08:44.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=16776 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:08:44.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:08:45.021+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:08:45.412+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702125:412386][16776:0x7f6e7d7a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:08:45.412+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:08:45.432+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e7c6d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E7C6B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E7D38C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E7D188000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E7CE8E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E7CC79000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E7CA5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E7C6B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E7D595000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e7c6d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:08:45.432+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:09:44.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=17025 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:09:44.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:09:44.566+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:09:44.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:09:44.960+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702184:960343][17025:0x7fdd6ad4bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:09:44.960+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:09:44.971+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd69c7b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD69C5A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA94FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD6A932000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD6A72E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD6A434000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD6A21F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD6A002000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD69C5A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD6AB3B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd69c7b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:09:44.971+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:10:44.097+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] MongoDB starting : pid=17224 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:10:44.103+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:10:44.153+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:10:44.526+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702244:526284][17224:0x7fd4d15e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:10:44.526+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:10:44.546+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4d0518635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4D04F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDAAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD4D11CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD4D0FCB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD4D0CD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD4D0ABC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD4D089F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4D04F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4D13D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4d0518635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:10:44.546+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:11:44.945+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] MongoDB starting : pid=17440 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:11:44.952+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:11:45.002+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:11:45.357+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702305:357845][17440:0x7f2abfeb0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:11:45.358+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:11:45.378+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2abede0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2ABEDBF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF252FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2ABFA97000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2ABF893000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2ABF599000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2ABF384000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2ABF167000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2ABEDBF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2ABFCA0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2abede0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:11:45.378+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:12:44.513+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:12:44.520+0000 I CONTROL [initandlisten] MongoDB starting : pid=17732 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:12:44.520+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:12:44.521+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:12:44.572+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:12:44.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702364:994355][17732:0x7f7d960afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:12:44.994+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:12:45.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d94fdf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D94FBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74228000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D95C96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D95A92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D95798000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D95583000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D95366000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D94FBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D95E9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d94fdf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:12:45.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:13:44.141+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] MongoDB starting : pid=17904 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:13:44.148+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:13:44.198+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:13:44.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702424:533573][17904:0x7f495309bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:13:44.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:13:44.544+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4951fcb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4951FAA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D2CF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4952C82000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4952A7E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4952784000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F495256F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4952352000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4951FAA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4952E8B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4951fcb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:13:44.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:14:44.679+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] MongoDB starting : pid=18190 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:14:44.686+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:14:44.736+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:14:45.146+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702485:146073][18190:0x7f12da53ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:14:45.146+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:14:45.166+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12d946a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12D9449000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E6E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12DA121000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12D9F1D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12D9C23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F12D9A0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F12D97F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12D9449000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12DA32A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12d946a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:14:45.166+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:15:44.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=18419 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:15:44.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:15:44.367+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:15:44.725+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702544:725778][18419:0x7f89084fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:15:44.725+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:15:44.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f890742a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8907409000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCCCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F89080E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8907EDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8907BE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F89079CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F89077B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8907409000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F89082EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f890742a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:15:44.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:16:44.156+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] MongoDB starting : pid=18640 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:16:44.164+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:16:44.215+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:16:44.528+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702604:528423][18640:0x7f348fe96c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:16:44.528+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:16:44.538+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f348edc6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F348EDA5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD39CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F348FA7D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F348F879000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F348F57F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F348F36A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F348F14D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F348EDA5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F348FC86000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f348edc6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:16:44.538+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:17:44.662+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] MongoDB starting : pid=18855 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:17:44.669+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:17:44.720+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:17:45.058+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702665:58852][18855:0x7fc6ab53dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:17:45.058+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:17:45.082+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6aa46d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6AA44C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF27CFB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6AB124000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6AAF20000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6AAC26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6AAA11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC6AA7F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6AA44C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC6AB32D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6aa46d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:17:45.083+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:18:44.225+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] MongoDB starting : pid=19028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:18:44.237+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:18:44.290+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:18:44.686+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702724:686544][19028:0x7fd366862c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:18:44.686+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:18:44.697+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd365792635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD365771000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD366449000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD366245000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD365F4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD365D36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD365B19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD365771000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD366652000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd365792635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:18:44.697+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:19:44.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=19279 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:19:44.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:19:44.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:19:45.312+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702785:312022][19279:0x7f6dc2738c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:19:45.312+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:19:45.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6dc1668635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6DC1647000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF77293000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6DC231F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6DC211B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6DC1E21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6DC1C0C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6DC19EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6DC1647000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6DC2528000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6dc1668635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:19:45.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:20:44.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] MongoDB starting : pid=19480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:20:44.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:20:44.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:20:44.840+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702844:840939][19480:0x7fb064ca4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:20:44.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:20:44.860+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb063bd4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB063BB3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24A6B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB06488B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB064687000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB06438D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB064178000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB063F5B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB063BB3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB064A94000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb063bd4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:20:44.860+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:21:44.431+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] MongoDB starting : pid=19682 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:21:44.438+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:21:44.494+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:21:44.806+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702904:806246][19682:0x7f167aec7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:21:44.806+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:21:44.826+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1679df7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1679DD6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF6EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F167AAAE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F167A8AA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F167A5B0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F167A39B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F167A17E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1679DD6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F167ACB7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1679df7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:21:44.826+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:22:44.942+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:22:44.949+0000 I CONTROL [initandlisten] MongoDB starting : pid=19897 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:22:44.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:22:45.000+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:22:45.365+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507702965:365578][19897:0x7f93d30eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:22:45.365+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:22:45.385+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93d201e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93D1FFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93D2CD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93D2AD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93D27D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93D25C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93D23A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93D1FFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93D2EDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93d201e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:22:45.385+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:23:44.503+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] MongoDB starting : pid=20061 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:23:44.511+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:23:44.561+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:23:44.836+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703024:836042][20061:0x7f53f1938c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:23:44.836+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:23:44.846+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53f0868635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53F0847000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10252000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53F151F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53F131B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53F1021000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F53F0E0C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F53F0BEF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53F0847000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53F1728000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53f0868635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:23:44.846+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:24:44.962+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:24:44.969+0000 I CONTROL [initandlisten] MongoDB starting : pid=20177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:24:44.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:24:45.019+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:24:45.359+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703085:359365][20177:0x7feb3e86fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:24:45.359+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:24:45.370+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb3d79f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB3D77E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B06E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB3E456000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB3E252000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB3DF58000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB3DD43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB3DB26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB3D77E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB3E65F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb3d79f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:24:45.370+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:25:44.495+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] MongoDB starting : pid=20429 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:25:44.505+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:25:44.559+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:25:44.907+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703144:907792][20429:0x7f0458b94c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:25:44.907+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:25:44.919+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0457ac4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0457AA3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F045877B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0458577000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F045827D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0458068000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0457E4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0457AA3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0458984000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0457ac4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:25:44.919+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:26:44.794+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] MongoDB starting : pid=20638 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:26:44.801+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:26:44.851+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:26:45.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703205:158518][20638:0x7f480ef2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:26:45.158+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:26:45.169+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f480de5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F480DE3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF962FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F480EB13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F480E90F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F480E615000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F480E400000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F480E1E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F480DE3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F480ED1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f480de5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:26:45.169+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:27:44.290+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] MongoDB starting : pid=20853 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:27:44.297+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:27:44.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:27:44.758+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703264:758681][20853:0x7fc50d8b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:27:44.758+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:27:44.778+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc50c7e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC50C7C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA1AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC50D49D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC50D299000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC50CF9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC50CD8A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC50CB6D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC50C7C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC50D6A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc50c7e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:27:44.778+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:28:44.909+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] MongoDB starting : pid=21140 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:28:44.917+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:28:44.967+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:28:45.323+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703325:323093][21140:0x7f1dbcbe8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:28:45.323+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:28:45.334+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dbbb18635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DBBAF7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DBC7CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DBC5CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DBC2D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DBC0BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DBBE9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DBBAF7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DBC9D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dbbb18635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:28:45.334+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:29:44.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=21256 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:29:44.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:29:44.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:29:44.895+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703384:895545][21256:0x7fcf3ecf3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:29:44.895+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:29:44.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf3dc23635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF3DC02000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DCB9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF3E8DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF3E6D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF3E3DC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF3E1C7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF3DFAA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF3DC02000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF3EAE3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf3dc23635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:29:44.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:30:45.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] MongoDB starting : pid=21516 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:30:45.042+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:30:45.043+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:30:45.092+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:30:45.422+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703445:422419][21516:0x7fe7113cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:30:45.422+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:30:45.433+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe710300635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7102DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FE711CDF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE710FB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE710DB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE710AB9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7108A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE710687000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7102DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7111C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe710300635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:30:45.433+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:31:44.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] MongoDB starting : pid=21722 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:31:44.896+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:31:44.946+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:31:45.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703505:218163][21722:0x7fa17deb5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:31:45.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:31:45.228+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa17cde5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA17CDC4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE1EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA17DA9C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA17D898000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA17D59E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA17D389000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA17D16C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA17CDC4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA17DCA5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa17cde5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:31:45.228+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:32:44.362+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] MongoDB starting : pid=21942 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:32:44.369+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:32:44.419+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:32:44.781+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703564:781527][21942:0x7ffe9aff9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:32:44.781+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:32:44.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe99f29635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE99F08000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8568F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE9ABE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE9A9DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE9A6E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE9A4CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE9A2B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE99F08000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE9ADE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe99f29635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:32:44.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:33:44.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] MongoDB starting : pid=22197 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:33:44.923+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:33:44.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:33:45.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703625:315532][22197:0x7fcb4f823c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:33:45.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:33:45.326+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb4e753635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB4E732000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB4F40A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB4F206000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB4EF0C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB4ECF7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB4EADA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB4E732000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB4F613000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb4e753635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:33:45.326+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:34:44.460+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] MongoDB starting : pid=22323 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:34:44.467+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:34:44.518+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:34:44.830+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703684:830036][22323:0x7f7e64b62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:34:44.830+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:34:44.840+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e63a92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E63A71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF960FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E64749000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E64545000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E6424B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E64036000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E63E19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E63A71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E64952000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e63a92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:34:44.840+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:35:44.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] MongoDB starting : pid=22576 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:35:44.966+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:35:45.015+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:35:45.396+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703745:396346][22576:0x7f805047bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:35:45.396+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:35:45.415+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f804f3ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F804F38A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1FB8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8050062000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F804FE5E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F804FB64000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F804F94F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F804F732000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F804F38A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F805026B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f804f3ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:35:45.415+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:36:44.830+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] MongoDB starting : pid=22782 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:36:44.838+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:36:44.888+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:36:45.290+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703805:290200][22782:0x7fdf03786c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:36:45.290+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:36:45.300+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf026b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF02695000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF0336D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF03169000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF02E6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF02C5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF02A3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF02695000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF03576000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf026b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:36:45.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:37:44.448+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:37:44.455+0000 I CONTROL [initandlisten] MongoDB starting : pid=22987 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:37:44.455+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:37:44.455+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:37:44.455+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:37:44.455+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:37:44.456+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:37:44.456+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:37:44.456+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:37:44.456+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:37:44.506+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:37:44.868+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703864:868154][22987:0x7f9ba74cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:37:44.868+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:37:44.878+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ba63fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9BA63DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1A61000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9BA70B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9BA6EB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9BA6BB7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9BA69A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9BA6785000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9BA63DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9BA72BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ba63fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:37:44.878+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:38:45.007+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=23252 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:38:45.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:38:45.065+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:38:45.366+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703925:366573][23252:0x7f5c9e8fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:38:45.366+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:38:45.377+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c9d82b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C9D80A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C9E4E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C9E2DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C9DFE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C9DDCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C9DBB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C9D80A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C9E6EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c9d82b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:38:45.377+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:39:44.500+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:39:44.512+0000 I CONTROL [initandlisten] MongoDB starting : pid=23374 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:39:44.513+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:39:44.573+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:39:44.901+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507703984:901765][23374:0x7f5ae352fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:39:44.901+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:39:44.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ae245f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AE243E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF78FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AE3116000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AE2F12000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AE2C18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AE2A03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AE27E6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AE243E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AE331F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ae245f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:39:44.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:40:45.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] MongoDB starting : pid=23642 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:40:45.045+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:40:45.099+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:40:45.403+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704045:403865][23642:0x7f5653e02c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:40:45.403+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:40:45.415+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5652d32635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5652D11000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF479FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56539E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56537E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56534EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56532D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56530B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5652D11000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5653BF2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5652d32635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:40:45.415+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:41:44.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] MongoDB starting : pid=23854 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:41:44.833+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:41:44.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:41:45.202+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704105:202579][23854:0x7f5679cb0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:41:45.202+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:41:45.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5678be0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5678BBF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA7C9D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5679897000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5679693000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5679399000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5679184000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5678F67000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5678BBF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5679AA0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5678be0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:41:45.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:42:44.322+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=24071 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:42:44.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:42:44.380+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:42:44.710+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704164:710746][24071:0x7f974c9f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:42:44.710+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:42:44.721+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f974b926635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F974B905000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD62FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F974C5DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F974C3D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F974C0DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F974BECA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F974BCAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F974B905000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F974C7E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f974b926635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:42:44.721+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:43:44.845+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] MongoDB starting : pid=24340 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:43:44.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:43:44.921+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:43:45.201+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704225:201330][24340:0x7f1521f14c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:43:45.201+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:43:45.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1520e44635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1520E23000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD1D5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1521AFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15218F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15215FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15213E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15211CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1520E23000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1521D04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1520e44635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:43:45.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:44:44.330+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] MongoDB starting : pid=24456 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:44:44.337+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:44:44.388+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:44:44.759+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704284:759264][24456:0x7f3eac245c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:44:44.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:44:44.769+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3eab175635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3EAB154000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF50AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3EABE2C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3EABC28000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3EAB92E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3EAB719000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3EAB4FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3EAB154000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3EAC035000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3eab175635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:44:44.769+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:45:44.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] MongoDB starting : pid=24712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:45:44.903+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:45:44.953+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:45:45.293+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704345:293449][24712:0x7fdb109d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:45:45.293+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:45:45.305+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb0f908635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB0F8E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB105BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB103BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB100C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB0FEAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB0FC8F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB0F8E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB107C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb0f908635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:45:45.305+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:46:44.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] MongoDB starting : pid=24917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:46:44.733+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:46:44.783+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:46:45.078+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704405:78441][24917:0x7fb9b8114c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:46:45.078+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:46:45.088+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb9b7044635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB9B7023000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE50D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB9B7CFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB9B7AF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB9B77FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB9B75E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9B73CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB9B7023000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB9B7F04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb9b7044635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:46:45.088+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:47:44.370+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=25116 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:47:44.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:47:44.429+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:47:44.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704464:775310][25116:0x7f9921e05c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:47:44.775+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:47:44.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9920d35635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9920D14000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF738FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99219EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99217E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99214EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99212D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99210BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9920D14000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9921BF5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9920d35635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:47:44.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:48:44.925+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:48:44.932+0000 I CONTROL [initandlisten] MongoDB starting : pid=25383 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:48:44.933+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:48:44.982+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:48:45.347+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704525:346988][25383:0x7f437c933c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:48:45.347+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:48:45.357+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f437b863635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F437B842000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C037000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F437C51A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F437C316000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F437C01C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F437BE07000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F437BBEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F437B842000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F437C723000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f437b863635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:48:45.357+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:49:44.487+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=25513 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:49:44.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:49:44.495+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:49:44.544+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:49:44.942+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704584:942205][25513:0x7f6671f62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:49:44.942+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:49:44.961+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6670e92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6670E71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000004FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6671B49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6671945000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F667164B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6671436000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6671219000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6670E71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6671D52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6670e92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:49:44.962+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:50:44.091+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] MongoDB starting : pid=25780 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:50:44.098+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:50:44.147+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:50:44.536+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704644:536173][25780:0x7f9da74fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:50:44.536+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:50:44.552+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9da642a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9DA6409000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36E99000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9DA70E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9DA6EDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9DA6BE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9DA69CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9DA67B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9DA6409000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9DA72EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9da642a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:50:44.552+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:51:44.967+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:51:44.974+0000 I CONTROL [initandlisten] MongoDB starting : pid=25988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:51:44.974+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:51:44.974+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:51:44.974+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:51:44.974+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:51:44.975+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:51:44.975+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:51:44.975+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:51:44.975+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:51:45.026+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:51:45.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704705:416306][25988:0x7f4931214c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:51:45.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:51:45.436+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4930144635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4930123000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4FD6B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4930DFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4930BF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F49308FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F49306E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F49304CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4930123000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4931004000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4930144635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:51:45.436+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:52:44.690+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] MongoDB starting : pid=26195 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:52:44.697+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:52:44.746+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:52:45.075+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704765:75318][26195:0x7f5eb671cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:52:45.075+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:52:45.095+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5eb564c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5EB562B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EB6303000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EB60FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EB5E05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5EB5BF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5EB59D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5EB562B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EB650C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5eb564c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:52:45.095+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:53:44.226+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] MongoDB starting : pid=26438 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:53:44.233+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:53:44.283+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:53:44.693+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704824:693053][26438:0x7fca940cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:53:44.693+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:53:44.712+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca92ffd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA92FDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A6F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA93CB4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA93AB0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA937B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA935A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA93384000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA92FDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA93EBD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca92ffd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:53:44.712+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:54:44.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=26577 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:54:44.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:54:44.901+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:54:45.323+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704885:323577][26577:0x7fea9250dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:54:45.323+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:54:45.343+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea9143d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA9141C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD6C3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA920F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA91EF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA91BF6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA919E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA917C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA9141C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA922FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea9143d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:54:45.343+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:55:44.464+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:55:44.472+0000 I CONTROL [initandlisten] MongoDB starting : pid=26835 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:55:44.473+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:55:44.524+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:55:44.947+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507704944:947818][26835:0x7fb7ed0f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:55:44.947+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:55:44.967+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb7ec024635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB7EC003000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF786FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB7ECCDB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB7ECAD7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB7EC7DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB7EC5C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB7EC3AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB7EC003000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB7ECEE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb7ec024635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:55:44.967+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:56:44.424+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] MongoDB starting : pid=27041 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:56:44.432+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:56:44.487+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:56:44.863+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705004:863302][27041:0x7f574bf50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:56:44.863+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:56:44.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f574ae80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F574AE5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F574BB37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F574B933000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F574B639000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F574B424000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F574B207000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F574AE5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F574BD40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f574ae80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:56:44.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:57:45.019+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] MongoDB starting : pid=27245 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:57:45.026+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:57:45.075+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:57:45.500+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705065:500059][27245:0x7ff5322aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:57:45.500+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:57:45.510+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff5311de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF5311BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D187000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF531E95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF531C91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF531997000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF531782000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF531565000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF5311BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF53209E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff5311de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:57:45.510+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:58:44.629+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] MongoDB starting : pid=27506 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:58:44.636+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:58:44.686+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:58:45.032+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705125:32739][27506:0x7fe3997ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:58:45.032+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:58:45.043+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe39871c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE3986FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB34FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE3993D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE3991CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE398ED5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE398CC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE398AA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE3986FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE3995DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe39871c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:58:45.043+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T06:59:44.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=27635 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] modules: none 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] build environment: 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T06:59:44.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T06:59:44.233+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T06:59:44.628+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705184:628283][27635:0x7fb0463c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T06:59:44.628+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T06:59:44.647+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0452f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0452D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF116FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB045FA8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB045DA4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB045AAA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB045895000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB045678000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0452D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0461B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0452f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T06:59:44.647+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:00:44.779+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] MongoDB starting : pid=27762 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:00:44.787+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:00:44.837+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:00:45.348+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705245:348355][27762:0x7fde66f5ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:00:45.348+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:00:45.368+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde65e8a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE65E69000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB14C1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE66B41000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE6693D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE66643000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE6642E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE66211000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE65E69000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE66D4A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde65e8a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:00:45.368+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:01:44.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] MongoDB starting : pid=28020 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:01:44.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:01:44.810+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:01:45.267+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705305:267072][28020:0x7f1b45d60c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:01:45.267+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:01:45.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b44c90635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B44C6F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B45947000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B45743000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B45449000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B45234000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B45017000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B44C6F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B45B50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b44c90635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:01:45.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:02:44.077+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] MongoDB starting : pid=28224 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:02:44.088+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:02:44.140+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:02:44.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705364:511026][28224:0x7f2cdc34dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:02:44.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:02:44.521+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2cdb27d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CDB25C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE0E0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CDBF34000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CDBD30000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CDBA36000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CDB821000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CDB604000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CDB25C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CDC13D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2cdb27d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:02:44.521+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:03:44.650+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:03:44.657+0000 I CONTROL [initandlisten] MongoDB starting : pid=28460 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:03:44.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:03:44.707+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:03:45.101+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705425:101289][28460:0x7f595cc74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:03:45.101+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:03:45.112+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f595bba4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F595BB83000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF582FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F595C85B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F595C657000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F595C35D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F595C148000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F595BF2B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F595BB83000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F595CA64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f595bba4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:03:45.112+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:04:44.244+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] MongoDB starting : pid=28685 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:04:44.252+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:04:44.304+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:04:44.660+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705484:660578][28685:0x7f51a7209c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:04:44.660+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:04:44.671+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51a6139635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51A6118000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51A6DF0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51A6BEC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51A68F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51A66DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51A64C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51A6118000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51A6FF9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51a6139635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:04:44.671+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:05:44.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] MongoDB starting : pid=28802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:05:44.794+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:05:44.845+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:05:45.270+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705545:270915][28802:0x7fd564094c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:05:45.271+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:05:45.293+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd562fc4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD562FA3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48CB4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD563C7B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD563A77000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD56377D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD563568000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD56334B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD562FA3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD563E84000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd562fc4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:05:45.293+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:06:44.702+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] MongoDB starting : pid=29059 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:06:44.709+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:06:44.710+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:06:44.710+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:06:44.759+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:06:45.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705605:152747][29059:0x7f011677dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:06:45.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:06:45.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f01156ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F011568C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94893000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0116364000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0116160000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0115E66000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0115C51000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0115A34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F011568C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F011656D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f01156ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:06:45.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:07:44.323+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:07:44.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=29259 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:07:44.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:07:44.383+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:07:44.803+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705664:803599][29259:0x7f9d70053c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:07:44.803+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:07:44.823+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d6ef83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D6EF62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D6FC3A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D6FA36000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D6F73C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D6F527000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D6F30A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D6EF62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D6FE43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d6ef83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:07:44.823+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:08:44.955+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] MongoDB starting : pid=29509 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:08:44.963+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:08:45.013+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:08:45.372+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705725:372235][29509:0x7f28199f0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:08:45.372+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:08:45.384+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2818920635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28188FF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26DD6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28195D7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28193D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28190D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2818EC4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2818CA7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28188FF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28197E0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2818920635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:08:45.384+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:09:44.524+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] MongoDB starting : pid=29736 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:09:44.531+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:09:44.532+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:09:44.532+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:09:44.581+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:09:45.020+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705785:20918][29736:0x7f8121b6fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:09:45.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:09:45.031+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8120a9f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8120A7E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF427D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8121756000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8121552000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8121258000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8121043000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8120E26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8120A7E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F812195F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8120a9f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:09:45.031+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:10:44.159+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] MongoDB starting : pid=29856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:10:44.166+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:10:44.216+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:10:44.618+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705844:618845][29856:0x7ff19f86fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:10:44.618+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:10:44.631+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff19e79f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF19E77E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF19F456000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF19F252000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF19EF58000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF19ED43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF19EB26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF19E77E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF19F65F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff19e79f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:10:44.631+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:11:45.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] MongoDB starting : pid=30116 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:11:45.041+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:11:45.090+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:11:45.441+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705905:441422][30116:0x7f6a647a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:11:45.441+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:11:45.462+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a636d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A636B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4134000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A64389000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A64185000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A63E8B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A63C76000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A63A59000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A636B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A64592000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a636d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:11:45.462+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:12:44.364+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] MongoDB starting : pid=30328 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:12:44.371+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:12:44.421+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:12:44.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507705964:795529][30328:0x7f1a99fd7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:12:44.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:12:44.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a98f07635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A98EE6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A99BBE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A999BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A996C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A994AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A9928E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A98EE6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A99DC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a98f07635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:12:44.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:13:44.946+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] MongoDB starting : pid=30572 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:13:44.953+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:13:45.003+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:13:45.326+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706025:326970][30572:0x7fed7d0b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:13:45.327+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:13:45.338+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed7bfe4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED7BFC3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF81D89000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED7CC9B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED7CA97000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED7C79D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED7C588000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED7C36B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED7BFC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED7CEA4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed7bfe4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:13:45.338+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:14:44.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] MongoDB starting : pid=30802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:14:44.476+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:14:44.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:14:44.876+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706084:876061][30802:0x7f0902548c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:14:44.876+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:14:44.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0901478635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0901457000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F090212F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0901F2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0901C31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0901A1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09017FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0901457000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0902338000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0901478635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:14:44.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:15:45.008+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] MongoDB starting : pid=30928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:15:45.016+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:15:45.065+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:15:45.417+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706145:417333][30928:0x7f665db15c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:15:45.417+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:15:45.427+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f665ca45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F665CA24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3A59000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F665D6FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F665D4F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F665D1FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F665CFE9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F665CDCC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F665CA24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F665D905000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f665ca45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:15:45.427+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:16:44.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=31187 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:16:44.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:16:44.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:16:45.149+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706205:149118][31187:0x7f4a6ae54c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:16:45.149+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:16:45.159+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a69d84635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A69D63000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BE6D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A6AA3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A6A837000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A6A53D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A6A328000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A6A10B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A69D63000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A6AC44000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a69d84635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:16:45.159+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:17:44.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] MongoDB starting : pid=31388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:17:44.551+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:17:44.601+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:17:44.941+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706264:941103][31388:0x7fef796ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:17:44.941+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:17:44.952+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef7860d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF785EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1D6C8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF792C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF790C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF78DC6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF78BB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF78994000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF785EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF794CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef7860d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:17:44.952+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:18:44.083+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] MongoDB starting : pid=31633 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:18:44.091+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:18:44.143+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:18:44.468+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706324:468550][31633:0x7fe1cd7c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:18:44.468+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:18:44.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1cc6f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1CC6D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5325C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1CD3A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1CD1A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1CCEAB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1CCC96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1CCA79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1CC6D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1CD5B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1cc6f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:18:44.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:19:44.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] MongoDB starting : pid=31862 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:19:44.610+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:19:44.660+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:19:44.991+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706384:991635][31862:0x7f31c7b8bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:19:44.991+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:19:45.002+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f31c6abb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F31C6A9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63484000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F31C7772000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F31C756E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F31C7274000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F31C705F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F31C6E42000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F31C6A9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F31C797B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f31c6abb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:19:45.002+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:20:44.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] MongoDB starting : pid=31983 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:20:44.122+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:20:44.173+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:20:44.486+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706444:486615][31983:0x7f930d39ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:20:44.486+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:20:44.497+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f930c2ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F930C2AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F930CF85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F930CD81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F930CA87000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F930C872000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F930C655000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F930C2AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F930D18E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f930c2ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:20:44.497+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:21:44.900+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:21:44.908+0000 I CONTROL [initandlisten] MongoDB starting : pid=32249 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:21:44.908+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:21:44.908+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:21:44.908+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:21:44.908+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:21:44.909+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:21:44.909+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:21:44.909+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:21:44.909+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:21:44.958+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:21:45.316+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706505:316880][32249:0x7feaabec4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:21:45.316+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:21:45.327+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feaaadf4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEAAADD3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF703C0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEAABAAB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEAAB8A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEAAB5AD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEAAB398000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEAAB17B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEAAADD3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEAABCB4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feaaadf4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:21:45.327+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:22:44.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] MongoDB starting : pid=32451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:22:44.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:22:44.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:22:45.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706565:132353][32451:0x7fda55aa9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:22:45.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:22:45.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda549d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA549B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA70FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA55690000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA5548C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA55192000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA54F7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA54D60000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA549B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA55899000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda549d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:22:45.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:23:44.271+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] MongoDB starting : pid=32685 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:23:44.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:23:44.330+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:23:44.727+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706624:727207][32685:0x7fd0def99c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:23:44.727+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:23:44.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0ddec9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0DDEA8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD0DEB80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0DE97C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0DE682000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0DE46D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0DE250000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0DDEA8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0DED89000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0ddec9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:23:44.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:24:44.880+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] MongoDB starting : pid=449 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:24:44.888+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:24:44.938+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:24:45.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706685:306281][449:0x7f7a865f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:24:45.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:24:45.317+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a85524635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A85503000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF382D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A861DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A85FD7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A85CDD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A85AC8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A858AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A85503000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A863E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a85524635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:24:45.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:25:44.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] MongoDB starting : pid=567 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:25:44.447+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:25:44.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:25:44.829+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706744:829334][567:0x7f846a749c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:25:44.829+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:25:44.840+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8469679635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8469658000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCADE6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F846A330000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F846A12C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8469E32000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8469C1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8469A00000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8469658000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F846A539000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8469679635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:25:44.840+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:26:44.311+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:26:44.318+0000 I CONTROL [initandlisten] MongoDB starting : pid=827 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:26:44.319+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:26:44.369+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:26:44.744+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706804:744575][827:0x7eff1c3a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:26:44.744+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:26:44.755+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff1b2d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF1B2B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1245000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF1BF88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF1BD84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF1BA8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF1B875000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF1B658000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF1B2B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF1C191000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff1b2d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:26:44.755+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:27:44.778+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=1028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:27:44.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:27:44.838+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:27:45.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706865:243108][1028:0x7f18ce9bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:27:45.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:27:45.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18cd8ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18CD8CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF52061000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18CE5A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18CE3A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18CE0A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18CDE91000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18CDC74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18CD8CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18CE7AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18cd8ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:27:45.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:28:44.383+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=1284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:28:44.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:28:44.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:28:44.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706924:775549][1284:0x7fdf98ee2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:28:44.775+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:28:44.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf97e12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF97DF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF98AC9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF988C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF985CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF983B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF98199000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF97DF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF98CD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf97e12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:28:44.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:29:44.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] MongoDB starting : pid=1514 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:29:44.905+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:29:44.955+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:29:45.288+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507706985:288783][1514:0x7f13866a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:29:45.288+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:29:45.299+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f13855d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F13855B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF518FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1386290000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F138608C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1385D92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1385B7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1385960000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F13855B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1386499000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f13855d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:29:45.299+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:30:44.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] MongoDB starting : pid=1629 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:30:44.427+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:30:44.478+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:30:44.876+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707044:876749][1629:0x7f3320bf2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:30:44.876+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:30:44.896+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f331fb22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F331FB01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF680FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33207D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33205D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33202DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33200C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F331FEA9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F331FB01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33209E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f331fb22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:30:44.896+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:31:44.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] MongoDB starting : pid=1885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:31:44.309+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:31:44.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:31:44.763+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707104:763815][1885:0x7f1c37b59c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:31:44.763+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:31:44.783+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c36a89635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C36A68000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5E8D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C37740000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C3753C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C37242000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C3702D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C36E10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C36A68000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C37949000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c36a89635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:31:44.783+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:32:44.854+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=2090 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:32:44.862+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:32:44.912+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:32:45.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707165:266186][2090:0x7fc9b81a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:32:45.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:32:45.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9b70d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9B70B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF153E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9B7D89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9B7B85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9B788B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9B7676000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9B7459000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9B70B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9B7F92000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9b70d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:32:45.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:33:44.400+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] MongoDB starting : pid=2335 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:33:44.408+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:33:44.458+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:33:44.859+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707224:859789][2335:0x7f7aa2572c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:33:44.859+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:33:44.879+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7aa14a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7AA1481000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7AA2159000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7AA1F55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7AA1C5B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7AA1A46000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7AA1829000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7AA1481000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7AA2362000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7aa14a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:33:44.879+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:34:45.007+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=2571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:34:45.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:34:45.070+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:34:45.499+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707285:499147][2571:0x7f2d01c7cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:34:45.499+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:34:45.519+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d00bac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D00B8B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C2DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D01863000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D0165F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D01365000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D01150000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D00F33000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D00B8B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D01A6C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d00bac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:34:45.519+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:35:44.640+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:35:44.647+0000 I CONTROL [initandlisten] MongoDB starting : pid=2679 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:35:44.647+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:35:44.647+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:35:44.647+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:35:44.647+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:35:44.647+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:35:44.648+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:35:44.648+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:35:44.648+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:35:44.697+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:35:45.063+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707345:63363][2679:0x7f3a54146c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:35:45.063+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:35:45.074+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3a53076635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3A53055000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3A53D2D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3A53B29000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3A5382F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3A5361A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3A533FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3A53055000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3A53F36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3a53076635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:35:45.074+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:36:44.563+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] MongoDB starting : pid=2800 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:36:44.570+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:36:44.626+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:36:45.064+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707405:64516][2800:0x7fa5c70ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:36:45.064+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:36:45.085+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5c601b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5C5FFA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5C6CD2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5C6ACE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5C67D4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5C65BF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5C63A2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5C5FFA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5C6EDB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5c601b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:36:45.085+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:37:44.942+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] MongoDB starting : pid=3056 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:37:44.949+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:37:44.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:37:44.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:37:45.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707465:416795][3056:0x7f33a73aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:37:45.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:37:45.427+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33a62de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33A62BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD58FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33A6F95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33A6D91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33A6A97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33A6882000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33A6665000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33A62BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33A719E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33a62de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:37:45.427+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:38:44.563+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:38:44.570+0000 I CONTROL [initandlisten] MongoDB starting : pid=3296 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:38:44.571+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:38:44.621+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:38:45.029+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707525:29574][3296:0x7f94c344ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:38:45.029+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:38:45.040+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94c237e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F94C235D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4A2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F94C3035000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F94C2E31000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F94C2B37000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F94C2922000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F94C2705000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F94C235D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94C323E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94c237e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:38:45.040+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:39:44.168+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=3529 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:39:44.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:39:44.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:39:44.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707584:668368][3529:0x7fe0908dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:39:44.668+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:39:44.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe08f80b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE08F7EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0904C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0902BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE08FFC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE08FDAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE08FB92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE08F7EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0906CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe08f80b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:39:44.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:40:44.818+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] MongoDB starting : pid=3735 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:40:44.826+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:40:44.878+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:40:45.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707645:305728][3735:0x7f3adcf16c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:40:45.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:40:45.316+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3adbe46635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3ADBE25000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF75CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3ADCAFD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3ADC8F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3ADC5FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3ADC3EA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3ADC1CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3ADBE25000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3ADCD06000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3adbe46635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:40:45.316+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:41:44.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] MongoDB starting : pid=3860 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:41:44.771+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:41:44.821+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:41:45.185+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707705:185841][3860:0x7fc270946c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:41:45.185+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:41:45.196+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc26f876635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC26F855000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC27052D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC270329000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC27002F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC26FE1A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC26FBFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC26F855000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC270736000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc26f876635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:41:45.196+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:42:44.226+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] MongoDB starting : pid=4123 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:42:44.233+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:42:44.283+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:42:44.656+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707764:655999][4123:0x7fb361f8fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:42:44.656+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:42:44.667+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb360ebf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB360E9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB361B76000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB361972000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB361678000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB361463000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB361246000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB360E9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB361D7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb360ebf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:42:44.667+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:43:44.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] MongoDB starting : pid=4370 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:43:44.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:43:44.850+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:43:45.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707825:266641][4370:0x7fa1cc8bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:43:45.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:43:45.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1cb7eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1CB7CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9B16000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1CC4A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1CC29E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1CBFA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1CBD8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1CBB72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1CB7CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1CC6AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1cb7eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:43:45.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:44:44.418+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=4613 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:44:44.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:44:44.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:44:44.923+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707884:923028][4613:0x7fcbf0e8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:44:44.923+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:44:44.933+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbefdbd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBEFD9C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBF0A74000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBF0870000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBF0576000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBF0361000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBF0144000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBEFD9C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBF0C7D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbefdbd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:44:44.933+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:45:44.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:45:44.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=4833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:45:44.065+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:45:44.065+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:45:44.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:45:44.066+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:45:44.066+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:45:44.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:45:44.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:45:44.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:45:44.116+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:45:44.557+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507707944:557630][4833:0x7ff79e2f5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:45:44.557+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:45:44.580+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff79d225635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF79D204000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEC6B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF79DEDC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF79DCD8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF79D9DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF79D7C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF79D5AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF79D204000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF79E0E5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff79d225635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:45:44.580+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:46:44.966+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] MongoDB starting : pid=4982 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:46:44.973+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:46:45.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:46:45.397+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708005:397930][4982:0x7fc3f24c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:46:45.398+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:46:45.417+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc3f13f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC3F13D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74AA4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3F20A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3F1EA4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3F1BAA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3F1995000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3F1778000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3F13D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3F22B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc3f13f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:46:45.417+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:47:44.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] MongoDB starting : pid=5510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:47:44.627+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:47:44.677+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:47:45.066+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708065:66763][5510:0x7f64b2f03c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:47:45.066+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:47:45.077+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f64b1e33635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F64B1E12000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC80FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F64B2AEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F64B28E6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F64B25EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F64B23D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F64B21BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F64B1E12000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F64B2CF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f64b1e33635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:47:45.077+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:48:44.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=5918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:48:44.206+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:48:44.256+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:48:44.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708124:696728][5918:0x7f986637dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:48:44.696+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:48:44.707+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98652ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F986528C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9865F64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9865D60000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9865A66000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9865851000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9865634000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F986528C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F986616D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98652ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:48:44.707+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:49:44.850+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] MongoDB starting : pid=6280 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:49:44.857+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:49:44.907+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:49:45.337+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708185:337888][6280:0x7ff3a83c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:49:45.337+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:49:45.357+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3a72f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3A72D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8BCD6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3A7FAC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3A7DA8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3A7AAE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3A7899000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3A767C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3A72D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3A81B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3a72f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:49:45.357+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:50:44.475+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] MongoDB starting : pid=6568 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:50:44.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:50:44.532+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:50:44.926+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708244:926783][6568:0x7f81688b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:50:44.926+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:50:44.939+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f81677e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F81677C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A2EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F816849D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8168299000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8167F9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8167D8A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8167B6D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F81677C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F81686A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f81677e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:50:44.939+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:51:44.316+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] MongoDB starting : pid=6687 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:51:44.323+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:51:44.373+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:51:44.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708304:795058][6687:0x7f2ca3b66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:51:44.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:51:44.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ca2a96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CA2A75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD2A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CA374D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CA3549000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CA324F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CA303A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CA2E1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CA2A75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CA3956000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ca2a96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:51:44.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:52:44.860+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] MongoDB starting : pid=6967 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:52:44.867+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:52:44.920+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:52:45.367+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708365:367792][6967:0x7f810aee7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:52:45.367+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:52:45.387+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8109e17635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8109DF6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F810AACE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F810A8CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F810A5D0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F810A3BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F810A19E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8109DF6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F810ACD7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8109e17635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:52:45.387+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:53:44.519+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:53:44.526+0000 I CONTROL [initandlisten] MongoDB starting : pid=7205 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:53:44.527+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:53:44.576+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:53:44.929+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708424:929094][7205:0x7f7a53675c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:53:44.929+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:53:44.948+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a525a5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A52584000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2D0DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A5325C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A53058000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A52D5E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A52B49000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A5292C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A52584000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A53465000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a525a5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:53:44.948+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:54:44.079+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] MongoDB starting : pid=7436 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:54:44.087+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:54:44.151+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:54:44.567+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708484:567805][7436:0x7fa2bb622c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:54:44.567+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:54:44.578+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa2ba552635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA2BA531000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA2BB209000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA2BB005000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA2BAD0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA2BAAF6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA2BA8D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA2BA531000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA2BB412000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa2ba552635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:54:44.578+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:55:44.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=7638 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:55:44.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:55:44.764+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:55:45.118+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708545:118300][7638:0x7f4a66f66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:55:45.118+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:55:45.128+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a65e96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A65E75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A66B4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A66949000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A6664F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A6643A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A6621D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A65E75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A66D56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a65e96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:55:45.128+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:56:44.538+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] MongoDB starting : pid=7761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:56:44.545+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:56:44.596+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:56:44.928+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708604:928270][7761:0x7f56aaae5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:56:44.928+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:56:44.939+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56a9a15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56A99F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD94FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56AA6CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56AA4C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56AA1CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56A9FB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56A9D9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56A99F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56AA8D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56a9a15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:56:44.939+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:57:44.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] MongoDB starting : pid=8012 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:57:44.873+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:57:44.923+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:57:45.299+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708665:299149][8012:0x7f0f6642ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:57:45.299+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:57:45.311+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0f6535e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0F6533D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93425000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0F66015000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0F65E11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0F65B17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0F65902000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0F656E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0F6533D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0F6621E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0f6535e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:57:45.311+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:58:44.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:58:44.447+0000 I CONTROL [initandlisten] MongoDB starting : pid=8260 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:58:44.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:58:44.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:58:44.925+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708724:925369][8260:0x7f8a34eedc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:58:44.925+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:58:44.944+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8a33e1d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8A33DFC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6E2C8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8A34AD4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8A348D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8A345D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8A343C1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8A341A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8A33DFC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8A34CDD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8a33e1d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:58:44.944+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T07:59:44.075+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] MongoDB starting : pid=8511 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] modules: none 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] build environment: 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T07:59:44.083+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T07:59:44.133+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T07:59:44.571+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708784:571190][8511:0x7f1d549e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T07:59:44.571+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T07:59:44.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d53919635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D538F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED6DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D545D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D543CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D540D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D53EBD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D53CA0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D538F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D547D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d53919635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T07:59:44.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:00:44.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] MongoDB starting : pid=8724 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:00:44.722+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:00:44.773+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:00:45.180+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708845:180932][8724:0x7fa53db34c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:00:45.181+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:00:45.191+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa53ca64635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA53CA43000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B8ED000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA53D71B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA53D517000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA53D21D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA53D008000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA53CDEB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA53CA43000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA53D924000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa53ca64635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:00:45.191+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:01:44.590+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=8844 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:01:44.598+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:01:44.648+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:01:45.080+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708905:80734][8844:0x7f0bc35aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:01:45.080+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:01:45.091+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0bc24de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0BC24BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF446FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0BC3195000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0BC2F91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0BC2C97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0BC2A82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0BC2865000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0BC24BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0BC339E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0bc24de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:01:45.091+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:02:44.131+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=9102 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:02:44.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:02:44.187+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:02:44.504+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507708964:504046][9102:0x7f2b9b745c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:02:44.504+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:02:44.515+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b9a675635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B9A654000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF55796000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B9B32C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B9B128000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B9AE2E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B9AC19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B9A9FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B9A654000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B9B535000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b9a675635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:02:44.515+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:03:44.652+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] MongoDB starting : pid=9340 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:03:44.660+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:03:44.712+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:03:45.075+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709025:74992][9340:0x7f1958dfcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:03:45.075+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:03:45.085+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1957d2c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1957D0B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19589E3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19587DF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19584E5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19582D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19580B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1957D0B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1958BEC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1957d2c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:03:45.085+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:04:44.213+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] MongoDB starting : pid=9578 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:04:44.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:04:44.270+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:04:44.676+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709084:675990][9578:0x7fbfb5261c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:04:44.676+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:04:44.696+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbfb4191635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBFB4170000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBFB4E48000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBFB4C44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBFB494A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBFB4735000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBFB4518000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBFB4170000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBFB5051000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbfb4191635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:04:44.696+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:05:44.830+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] MongoDB starting : pid=9787 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:05:44.837+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:05:44.887+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:05:45.350+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709145:350074][9787:0x7fea5da92c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:05:45.350+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:05:45.369+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea5c9c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA5C9A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54AFC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA5D679000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA5D475000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA5D17B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA5CF66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA5CD49000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA5C9A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA5D882000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea5c9c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:05:45.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:06:44.737+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] MongoDB starting : pid=9918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:06:44.745+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:06:44.795+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:06:45.248+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709205:248061][9918:0x7f83b69bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:06:45.248+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:06:45.268+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83b58ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83B58CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAB494000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83B65A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83B639F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83B60A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83B5E90000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83B5C73000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83B58CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83B67AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83b58ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:06:45.268+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:07:44.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=10182 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:07:44.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:07:44.359+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:07:44.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:07:44.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:07:44.817+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709264:817886][10182:0x7f452a8bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:07:44.817+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:07:44.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45297eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45297CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEB92D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F452A4A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F452A29E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4529FA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4529D8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4529B72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45297CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F452A6AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45297eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:07:44.837+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:08:44.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] MongoDB starting : pid=10430 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:08:44.966+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:08:45.015+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:08:45.439+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709325:439114][10430:0x7fa56adc1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:08:45.439+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:08:45.458+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa569cf1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA569CD0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56AB1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA56A9A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA56A7A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA56A4AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA56A295000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA56A078000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA569CD0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA56ABB1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa569cf1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:08:45.458+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:09:44.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] MongoDB starting : pid=10658 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:09:44.593+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:09:44.644+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:09:45.060+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709385:60420][10658:0x7f5dc528ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:09:45.060+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:09:45.080+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5dc41ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5DC4199000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E87C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5DC4E71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5DC4C6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5DC4973000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5DC475E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5DC4541000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5DC4199000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5DC507A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5dc41ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:09:45.080+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:10:44.208+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] MongoDB starting : pid=10841 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:10:44.212+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:10:44.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:10:44.697+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709444:697603][10841:0x7f2cdeb10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:10:44.697+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:10:44.718+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2cdda40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CDDA1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF23225000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CDE6F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CDE4F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CDE1F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CDDFE4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CDDDC7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CDDA1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CDE900000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2cdda40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:10:44.718+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:11:44.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] MongoDB starting : pid=10978 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:11:44.147+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:11:44.197+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:11:44.584+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709504:584556][10978:0x7f758af65c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:11:44.584+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:11:44.604+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7589e95635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7589E74000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84033000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F758AB4C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F758A948000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F758A64E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F758A439000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F758A21C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7589E74000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F758AD55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7589e95635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:11:44.604+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:12:44.737+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] MongoDB starting : pid=11161 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:12:44.745+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:12:44.794+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:12:45.236+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709565:236762][11161:0x7f714d826c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:12:45.236+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:12:45.256+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f714c756635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F714C735000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF858D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F714D40D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F714D209000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F714CF0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F714CCFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F714CADD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F714C735000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F714D616000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f714c756635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:12:45.256+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:13:44.788+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] MongoDB starting : pid=11493 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:13:44.796+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:13:44.846+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:13:45.202+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709625:202360][11493:0x7f062a2a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:13:45.202+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:13:45.214+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f06291d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F06291B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC32FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0629E8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0629C88000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F062998E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0629779000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F062955C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F06291B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F062A095000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f06291d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:13:45.215+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:14:44.331+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] MongoDB starting : pid=11737 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:14:44.338+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:14:44.389+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:14:44.807+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709684:807711][11737:0x7f1fe6f2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:14:44.807+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:14:44.826+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1fe5e5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1FE5E3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF47E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1FE6B12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1FE690E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1FE6614000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1FE63FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1FE61E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1FE5E3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1FE6D1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1fe5e5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:14:44.827+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:15:44.950+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] MongoDB starting : pid=11941 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:15:44.957+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:15:45.006+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:15:45.321+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709745:321292][11941:0x7fe104661c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:15:45.321+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:15:45.331+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe103591635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE103570000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF306FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE104248000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE104044000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE103D4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE103B35000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE103918000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE103570000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE104451000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe103591635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:15:45.331+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:16:44.730+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] MongoDB starting : pid=12148 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:16:44.738+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:16:44.788+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:16:45.231+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709805:231583][12148:0x7f5ea1948c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:16:45.231+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:16:45.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ea0878635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5EA0857000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD6CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EA152F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EA132B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EA1031000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5EA0E1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5EA0BFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5EA0857000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EA1738000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ea0878635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:16:45.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:17:44.370+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=12263 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:17:44.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:17:44.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:17:44.816+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709864:816326][12263:0x7f1e156c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:17:44.816+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:17:44.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e145f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E145D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E152AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E150A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E14DAC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E14B97000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E1497A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E145D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E154B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e145f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:17:44.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:18:44.112+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] MongoDB starting : pid=12533 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:18:44.124+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:18:44.182+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:18:44.605+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709924:605551][12533:0x7fb70c1cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:18:44.605+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:18:44.624+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb70b0fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB70B0DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCAC21000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB70BDB5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB70BBB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB70B8B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB70B6A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB70B485000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB70B0DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB70BFBE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb70b0fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:18:44.624+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:19:44.754+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] MongoDB starting : pid=12779 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:19:44.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:19:44.814+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:19:45.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507709985:242525][12779:0x7f86479c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:19:45.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:19:45.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86468f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86468D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF232DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86475AC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86473A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86470AE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8646E99000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8646C7C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86468D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86477B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86468f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:19:45.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:20:44.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] MongoDB starting : pid=12982 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:20:44.379+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:20:44.429+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:20:44.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710044:751508][12982:0x7f7234341c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:20:44.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:20:44.762+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7233271635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7233250000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF880FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7233F28000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7233D24000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7233A2A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7233815000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F72335F8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7233250000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7234131000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7233271635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:20:44.762+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:21:44.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] MongoDB starting : pid=13185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:21:44.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:21:44.260+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:21:44.595+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710104:595766][13185:0x7f4b155d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:21:44.595+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:21:44.606+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b14500635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B144DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DD27000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B151B7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B14FB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B14CB9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B14AA4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B14887000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B144DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B153C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b14500635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:21:44.606+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:22:44.732+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] MongoDB starting : pid=13313 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:22:44.740+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:22:44.793+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:22:45.213+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710165:213450][13313:0x7f1157319c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:22:45.213+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:22:45.224+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1156249635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1156228000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1156F00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1156CFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1156A02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F11567ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F11565D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1156228000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1157109000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1156249635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:22:45.224+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:23:44.213+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:23:44.220+0000 I CONTROL [initandlisten] MongoDB starting : pid=13582 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:23:44.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:23:44.272+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:23:44.671+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710224:671315][13582:0x7f15093c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:23:44.671+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:23:44.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15082f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15082CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEE5FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1508FA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1508DA3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1508AA9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1508894000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1508677000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15082CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15091B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15082f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:23:44.690+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:24:44.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] MongoDB starting : pid=13833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:24:44.832+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:24:44.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:24:45.238+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710285:238885][13833:0x7f5f11afac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:24:45.238+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:24:45.249+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5f10a2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5F10A09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA38E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5F116E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5F114DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5F111E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5F10FCE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5F10DB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5F10A09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5F118EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5f10a2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:24:45.249+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:25:44.367+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=14051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:25:44.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:25:44.424+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:25:44.860+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710344:860425][14051:0x7f5a2a99cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:25:44.860+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:25:44.879+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a298cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A298AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A2A583000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A2A37F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A2A085000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A29E70000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A29C53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A298AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A2A78C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a298cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:25:44.880+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:26:44.254+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] MongoDB starting : pid=14257 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:26:44.261+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:26:44.313+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:26:44.663+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710404:663135][14257:0x7f9ae269ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:26:44.663+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:26:44.682+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ae15ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9AE15A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9AE2281000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9AE207D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9AE1D83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9AE1B6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9AE1951000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9AE15A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9AE248A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ae15ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:26:44.682+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:27:44.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=14424 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:27:44.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:27:44.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:27:45.250+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710465:250665][14424:0x7fe34e13cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:27:45.250+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:27:45.269+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe34d06c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE34D04B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF174FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE34DD23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE34DB1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE34D825000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE34D610000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE34D3F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE34D04B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE34DF2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe34d06c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:27:45.269+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:28:44.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] MongoDB starting : pid=15023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:28:44.469+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:28:44.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:28:44.519+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:28:44.855+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710524:855824][15023:0x7fec0ace2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:28:44.855+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:28:44.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec09c12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC09BF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21CC9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC0A8C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC0A6C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC0A3CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC0A1B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC09F99000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC09BF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC0AAD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec09c12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:28:44.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:29:44.991+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] MongoDB starting : pid=15278 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:29:44.999+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:29:45.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:29:45.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710585:463578][15278:0x7ff62ce70c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:29:45.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:29:45.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff62bda0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF62BD7F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF351EA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF62CA57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF62C853000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF62C559000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF62C344000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF62C127000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF62BD7F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF62CC60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff62bda0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:29:45.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:30:44.606+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=15486 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:30:44.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:30:44.663+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:30:44.972+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710644:972897][15486:0x7f418759fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:30:44.972+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:30:44.983+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41864cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41864AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB7E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4187186000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4186F82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4186C88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4186A73000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4186856000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41864AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F418738F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41864cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:30:44.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:31:44.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=15694 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:31:44.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:31:44.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:31:44.737+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710704:737427][15694:0x7f83d3a2dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:31:44.737+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:31:44.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83d295d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83D293C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83D3614000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83D3410000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83D3116000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83D2F01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83D2CE4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83D293C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83D381D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83d295d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:31:44.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:32:44.867+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] MongoDB starting : pid=15815 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:32:44.875+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:32:44.926+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:32:45.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710765:276862][15815:0x7fb3fcacac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:32:45.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:32:45.287+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb3fb9fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB3FB9D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA7EB4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB3FC6B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB3FC4AD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB3FC1B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB3FBF9E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB3FBD81000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB3FB9D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB3FC8BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb3fb9fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:32:45.287+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:33:44.647+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=16082 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:33:44.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:33:44.704+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:33:45.065+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710825:65671][16082:0x7fa9bbf75c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:33:45.065+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:33:45.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9baea7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9BAE86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FA9BC886000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9BBB5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9BB95A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9BB660000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9BB44B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9BB22E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9BAE86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9BBD67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9baea7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:33:45.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:34:44.212+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] MongoDB starting : pid=16336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:34:44.220+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:34:44.272+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:34:44.634+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710884:634473][16336:0x7f9441064c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:34:44.634+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:34:44.653+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f943ff94635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F943FF73000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC26E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9440C4B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9440A47000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F944074D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9440538000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F944031B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F943FF73000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9440E54000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f943ff94635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:34:44.653+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:35:44.778+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=16534 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:35:44.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:35:44.836+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:35:45.219+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507710945:219709][16534:0x7f85c64b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:35:45.219+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:35:45.232+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f85c53e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F85C53C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0AB8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F85C6099000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F85C5E95000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F85C5B9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F85C5986000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F85C5769000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F85C53C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F85C62A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f85c53e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:35:45.232+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:36:44.639+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] MongoDB starting : pid=16742 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:36:44.646+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:36:44.696+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:36:45.099+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711005:99089][16742:0x7fdc565e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:36:45.099+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:36:45.119+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc55512635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC554F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC561C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC55FC5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC55CCB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC55AB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC55899000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC554F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC563D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc55512635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:36:45.119+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:37:44.244+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=16860 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:37:44.251+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:37:44.301+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:37:44.713+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711064:713019][16860:0x7f711ccdcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:37:44.713+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:37:44.732+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f711bc0c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F711BBEB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88803000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F711C8C3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F711C6BF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F711C3C5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F711C1B0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F711BF93000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F711BBEB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F711CACC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f711bc0c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:37:44.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:38:44.294+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] MongoDB starting : pid=17137 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:38:44.301+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:38:44.351+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:38:44.715+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711124:715547][17137:0x7f9d1ce3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:38:44.715+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:38:44.727+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d1bd6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D1BD4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D1CA23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D1C81F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D1C525000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D1C310000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D1C0F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D1BD4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D1CC2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d1bd6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:38:44.727+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:39:44.849+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] MongoDB starting : pid=17388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:39:44.857+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:39:44.906+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:39:45.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711185:240857][17388:0x7f634cacac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:39:45.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:39:45.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f634b9fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F634B9D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF828E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F634C6B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F634C4AD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F634C1B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F634BF9E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F634BD81000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F634B9D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F634C8BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f634b9fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:39:45.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:40:44.369+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] MongoDB starting : pid=17590 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:40:44.377+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:40:44.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:40:44.871+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711244:871420][17590:0x7f3e33fdac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:40:44.871+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:40:44.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e32f0a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E32EE9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36351000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E33BC1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E339BD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E336C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E334AE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E33291000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E32EE9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E33DCA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e32f0a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:40:44.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:41:44.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] MongoDB starting : pid=17802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:41:44.281+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:41:44.331+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:41:44.768+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711304:768045][17802:0x7f32fdc28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:41:44.768+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:41:44.778+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32fcb58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F32FCB37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F32FD80F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F32FD60B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F32FD311000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F32FD0FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F32FCEDF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F32FCB37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F32FDA18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32fcb58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:41:44.778+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:42:44.903+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:42:44.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=17924 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:42:44.910+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:42:44.911+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:42:44.961+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:42:45.400+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711365:400047][17924:0x7f1a5ca01c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:42:45.400+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:42:45.410+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a5b931635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A5B910000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEC06000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A5C5E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A5C3E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A5C0EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A5BED5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A5BCB8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A5B910000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A5C7F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a5b931635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:42:45.410+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:43:44.328+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] MongoDB starting : pid=18197 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:43:44.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:43:44.385+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:43:44.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711424:784058][18197:0x7ff4688f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:43:44.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:43:44.803+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff467824635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF467803000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF456FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF4684DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF4682D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF467FDD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF467DC8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF467BAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF467803000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF4686E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff467824635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:43:44.803+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:44:44.940+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] MongoDB starting : pid=18451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:44:44.949+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:44:44.998+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:44:45.393+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711485:393592][18451:0x7f50e36dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:44:45.393+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:44:45.413+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f50e260b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F50E25EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCCCA8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F50E32C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F50E30BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F50E2DC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F50E2BAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F50E2992000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F50E25EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F50E34CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f50e260b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:44:45.413+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:45:44.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] MongoDB starting : pid=18647 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:45:44.542+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:45:44.592+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:45:45.042+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711545:42838][18647:0x7f5dbd80bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:45:45.042+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:45:45.062+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5dbc73b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5DBC71A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1446D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5DBD3F2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5DBD1EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5DBCEF4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5DBCCDF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5DBCAC2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5DBC71A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5DBD5FB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5dbc73b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:45:45.062+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:46:44.528+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] MongoDB starting : pid=18831 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:46:44.535+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:46:44.585+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:46:45.007+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711605:7027][18831:0x7f24527f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:46:45.007+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:46:45.026+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2451721635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2451700000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF300FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F24523D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F24521D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2451EDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2451CC5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2451AA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2451700000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24525E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2451721635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:46:45.026+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:47:44.146+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] MongoDB starting : pid=18963 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:47:44.154+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:47:44.207+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:47:44.623+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711664:623015][18963:0x7f86e567ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:47:44.623+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:47:44.642+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86e45aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86E4589000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC50FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86E5261000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86E505D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86E4D63000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86E4B4E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86E4931000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86E4589000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86E546A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86e45aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:47:44.642+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:48:44.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] MongoDB starting : pid=19095 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:48:44.309+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:48:44.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:48:44.777+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711724:777316][19095:0x7f961ac97c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:48:44.777+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:48:44.787+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9619bc7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9619BA6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF838FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F961A87E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F961A67A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F961A380000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F961A16B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9619F4E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9619BA6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F961AA87000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9619bc7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:48:44.787+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:49:44.919+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:49:44.927+0000 I CONTROL [initandlisten] MongoDB starting : pid=19395 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:49:44.928+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:49:44.979+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:49:45.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711785:370752][19395:0x7f5195d40c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:49:45.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:49:45.382+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5194c70635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5194C4F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5195927000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5195723000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5195429000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5195214000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5194FF7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5194C4F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5195B30000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5194c70635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:49:45.382+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:50:44.516+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] MongoDB starting : pid=19595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:50:44.524+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:50:44.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:50:45.009+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711845:9921][19595:0x7f7da5030c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:50:45.010+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:50:45.033+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7da3f60635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DA3F3F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF208FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DA4C17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DA4A13000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DA4719000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DA4504000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DA42E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DA3F3F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DA4E20000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7da3f60635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:50:45.033+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:51:44.408+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] MongoDB starting : pid=19805 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:51:44.415+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:51:44.416+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:51:44.467+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:51:44.806+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711904:806670][19805:0x7f2cededfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:51:44.806+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:51:44.817+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2cece0f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CECDEE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8AD45000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CEDAC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CED8C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CED5C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CED3B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CED196000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CECDEE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CEDCCF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2cece0f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:51:44.817+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:52:44.938+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] MongoDB starting : pid=20016 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:52:44.946+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:52:44.997+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:52:45.392+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507711965:392731][20016:0x7f8906c36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:52:45.392+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:52:45.411+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8905b66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8905B45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F890681D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8906619000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F890631F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F890610A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8905EED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8905B45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8906A26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8905b66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:52:45.411+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:53:44.686+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] MongoDB starting : pid=20146 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:53:44.694+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:53:44.745+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:53:45.143+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712025:143384][20146:0x7f0e44f6fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:53:45.143+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:53:45.155+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e43e9f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E43E7E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54642000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E44B56000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E44952000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E44658000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E44443000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E44226000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E43E7E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E44D5F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e43e9f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:53:45.155+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:54:44.278+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] MongoDB starting : pid=20457 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:54:44.285+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:54:44.337+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:54:44.763+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712084:763931][20457:0x7f257a077c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:54:44.764+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:54:44.783+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2578fa7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2578F86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA04FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2579C5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2579A5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2579760000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F257954B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F257932E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2578F86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2579E67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2578fa7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:54:44.783+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:55:44.909+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] MongoDB starting : pid=20660 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:55:44.917+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:55:44.968+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:55:45.426+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712145:426639][20660:0x7f7b271cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:55:45.426+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:55:45.437+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7b260ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7B260DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C2F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7B26DB6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7B26BB2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7B268B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7B266A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7B26486000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7B260DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7B26FBF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7b260ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:55:45.437+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:56:44.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] MongoDB starting : pid=20865 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:56:44.832+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:56:44.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:56:45.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712205:305067][20865:0x7f81002d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:56:45.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:56:45.324+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80ff202635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80FF1E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D946000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80FFEB9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80FFCB5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80FF9BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80FF7A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80FF589000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80FF1E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F81000C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80ff202635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:56:45.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:57:44.458+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] MongoDB starting : pid=21091 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:57:44.466+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:57:44.515+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:57:44.956+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712264:956464][21091:0x7f99c1c54c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:57:44.956+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:57:44.976+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99c0b86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99C0B65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F99C2565000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99C183D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99C1639000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99C133F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99C112A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99C0F0D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99C0B65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99C1A46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99c0b86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:57:44.976+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:58:44.204+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] MongoDB starting : pid=21227 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:58:44.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:58:44.262+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:58:44.665+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712324:665787][21227:0x7f58b3d34c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:58:44.665+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:58:44.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58b2c64635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58B2C43000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0ECE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58B391B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58B3717000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58B341D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58B3208000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58B2FEB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58B2C43000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58B3B24000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58b2c64635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:58:44.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T08:59:44.803+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] MongoDB starting : pid=21545 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] modules: none 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] build environment: 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T08:59:44.811+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T08:59:44.861+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T08:59:45.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712385:304997][21545:0x7f88c27f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T08:59:45.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T08:59:45.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88c1726635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88C1705000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F88C23DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88C21D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88C1EDF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88C1CCA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88C1AAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88C1705000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F88C25E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88c1726635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T08:59:45.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:00:44.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] MongoDB starting : pid=21750 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:00:44.442+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:00:44.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:00:44.922+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712444:922539][21750:0x7fe62f37bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:00:44.922+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:00:44.933+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe62e2ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE62E28A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD81FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE62EF62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE62ED5E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE62EA64000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE62E84F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE62E632000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE62E28A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE62F16B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe62e2ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:00:44.933+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:01:44.372+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] MongoDB starting : pid=21958 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:01:44.380+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:01:44.430+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:01:44.803+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712504:803317][21958:0x7f18e2884c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:01:44.803+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:01:44.822+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18e17b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18E1793000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18E246B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18E2267000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18E1F6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18E1D58000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18E1B3B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18E1793000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18E2674000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18e17b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:01:44.823+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:02:44.310+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:02:44.317+0000 I CONTROL [initandlisten] MongoDB starting : pid=22170 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:02:44.318+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:02:44.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:02:44.802+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712564:802044][22170:0x7fbe31613c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:02:44.802+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:02:44.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbe30543635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBE30522000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF690F4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBE311FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBE30FF6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBE30CFC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBE30AE7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBE308CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBE30522000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBE31403000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbe30543635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:02:44.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:03:44.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] MongoDB starting : pid=22300 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:03:44.250+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:03:44.300+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:03:44.677+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712624:677372][22300:0x7f3cba578c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:03:44.677+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:03:44.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3cb94a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3CB9487000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3CBA15F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3CB9F5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3CB9C61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3CB9A4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3CB982F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3CB9487000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3CBA368000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3cb94a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:03:44.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:04:44.817+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:04:44.824+0000 I CONTROL [initandlisten] MongoDB starting : pid=22616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:04:44.825+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:04:44.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:04:45.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712685:306565][22616:0x7f799d9bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:04:45.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:04:45.326+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f799c8ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F799C8CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC874000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F799D5A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F799D3A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F799D0A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F799CE91000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F799CC74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F799C8CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F799D7AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f799c8ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:04:45.326+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:05:44.460+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] MongoDB starting : pid=22816 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:05:44.468+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:05:44.521+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:05:44.906+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712744:906511][22816:0x7f36dcb90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:05:44.906+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:05:44.918+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36dbac0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36DBA9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBADEB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36DC777000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36DC573000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36DC279000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36DC064000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36DBE47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36DBA9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36DC980000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36dbac0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:05:44.918+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:06:44.285+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] MongoDB starting : pid=23026 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:06:44.292+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:06:44.343+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:06:44.729+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712804:729469][23026:0x7f90b8ab0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:06:44.729+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:06:44.748+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90b79e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90B79BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90B8697000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90B8493000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90B8199000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90B7F84000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90B7D67000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90B79BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90B88A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90b79e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:06:44.748+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:07:44.857+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] MongoDB starting : pid=23226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:07:44.864+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:07:44.913+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:07:45.270+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712865:270467][23226:0x7fca1c7fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:07:45.270+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:07:45.284+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca1b72a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA1B709000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF682B3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA1C3E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA1C1DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA1BEE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA1BCCE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA1BAB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA1B709000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA1C5EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca1b72a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:07:45.284+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:08:44.589+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] MongoDB starting : pid=23356 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:08:44.597+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:08:44.650+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:08:45.045+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712925:45597][23356:0x7f7e5b05bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:08:45.045+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:08:45.065+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e59f8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E59F6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF694FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E5AC42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E5AA3E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E5A744000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E5A52F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E5A312000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E59F6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E5AE4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e59f8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:08:45.065+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:09:44.194+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] MongoDB starting : pid=23674 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:09:44.201+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:09:44.272+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:09:44.638+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507712984:638386][23674:0x7f8e43f13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:09:44.638+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:09:44.659+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e42e43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E42E22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D8BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E43AFA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E438F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E435FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E433E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E431CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E42E22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E43D03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e42e43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:09:44.659+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:10:44.778+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] MongoDB starting : pid=23878 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:10:44.785+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:10:44.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:10:44.835+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:10:45.189+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713045:189075][23878:0x7f0143f19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:10:45.189+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:10:45.199+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0142e49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0142E28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF014FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0143B00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01438FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0143602000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01433ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01431D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0142E28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0143D09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0142e49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:10:45.199+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:11:44.579+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] MongoDB starting : pid=24087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:11:44.587+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:11:44.637+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:11:45.030+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713105:30473][24087:0x7f475f9d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:11:45.030+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:11:45.041+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f475e902635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F475E8E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF430C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F475F5B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F475F3B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F475F0BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F475EEA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F475EC89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F475E8E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F475F7C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f475e902635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:11:45.041+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:12:44.166+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=24290 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:12:44.174+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:12:44.224+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:12:44.644+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713164:644201][24290:0x7f3f8f1e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:12:44.644+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:12:44.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f8e110635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F8E0EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F8EDC7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F8EBC3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F8E8C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F8E6B4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F8E497000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F8E0EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F8EFD0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f8e110635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:12:44.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:13:44.705+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] MongoDB starting : pid=24424 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:13:44.713+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:13:44.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:13:44.765+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:13:45.206+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713225:206156][24424:0x7fce5640fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:13:45.206+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:13:45.225+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce5533f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE5531E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB88FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE55FF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE55DF2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE55AF8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE558E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE556C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE5531E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE561FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce5533f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:13:45.225+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:14:44.365+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] MongoDB starting : pid=24723 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:14:44.373+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:14:44.424+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:14:44.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713284:707127][24723:0x7fd0aa7aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:14:44.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:14:44.717+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0a96de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0A96BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1F4D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD0AA395000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0AA191000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0A9E97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0A9C82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0A9A65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0A96BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0AA59E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0a96de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:14:44.717+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:15:44.850+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] MongoDB starting : pid=24933 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:15:44.858+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:15:44.911+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:15:45.362+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713345:362859][24933:0x7f1f6d487c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:15:45.362+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:15:45.382+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f6c3b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F6C396000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7ACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F6D06E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F6CE6A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F6CB70000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F6C95B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F6C73E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F6C396000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F6D277000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f6c3b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:15:45.382+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:16:44.812+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=25148 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:16:44.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:16:44.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:16:45.346+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713405:346758][25148:0x7f6015a85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:16:45.346+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:16:45.366+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f60149b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6014994000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBDAEA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F601566C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6015468000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F601516E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6014F59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6014D3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6014994000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6015875000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f60149b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:16:45.366+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:17:44.518+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=25353 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:17:44.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:17:44.526+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:17:44.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:17:44.912+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713464:912127][25353:0x7f8fb8e82c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:17:44.912+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:17:44.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8fb7db2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8FB7D91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C1D2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8FB8A69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8FB8865000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8FB856B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8FB8356000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8FB8139000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8FB7D91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8FB8C72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8fb7db2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:17:44.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:18:44.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:18:44.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=25477 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:18:44.883+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:18:44.933+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:18:45.359+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713525:359826][25477:0x7f76d9b9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:18:45.359+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:18:45.379+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f76d8acc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F76D8AAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F76D9783000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F76D957F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F76D9285000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F76D9070000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F76D8E53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F76D8AAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F76D998C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f76d8acc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:18:45.380+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:19:44.512+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] MongoDB starting : pid=25768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:19:44.519+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:19:44.568+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:19:44.953+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713584:953260][25768:0x7f9de838ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:19:44.953+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:19:44.973+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9de72be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9DE729D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF4C3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9DE7F75000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9DE7D71000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9DE7A77000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9DE7862000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9DE7645000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9DE729D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9DE817E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9de72be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:19:44.973+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:20:44.091+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] MongoDB starting : pid=25988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:20:44.099+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:20:44.100+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:20:44.150+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:20:44.554+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713644:554386][25988:0x7faedb7e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:20:44.554+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:20:44.573+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faeda713635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAEDA6F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB64FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAEDB3CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAEDB1C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAEDAECC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAEDACB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAEDAA9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAEDA6F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAEDB5D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faeda713635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:20:44.573+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:21:44.974+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] MongoDB starting : pid=26194 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:21:44.981+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:21:45.034+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:21:45.448+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713705:448802][26194:0x7fd90e044c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:21:45.448+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:21:45.468+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd90cf74635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD90CF53000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF012FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD90DC2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD90DA27000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD90D72D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD90D518000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD90D2FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD90CF53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD90DE34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd90cf74635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:21:45.468+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:22:44.584+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:22:44.591+0000 I CONTROL [initandlisten] MongoDB starting : pid=26384 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:22:44.592+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:22:44.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:22:45.077+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713765:77451][26384:0x7fcca77e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:22:45.077+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:22:45.097+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcca6717635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCA66F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF9D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCA73CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCA71CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCA6ED0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCA6CBB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCA6A9E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCA66F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCA75D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcca6717635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:22:45.097+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:23:45.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:23:45.062+0000 I CONTROL [initandlisten] MongoDB starting : pid=26519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:23:45.063+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:23:45.113+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:23:45.562+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713825:562025][26519:0x7fe6120aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:23:45.562+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:23:45.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe610fda635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE610FB9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F57E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE611C91000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE611A8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE611793000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE61157E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE611361000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE610FB9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE611E9A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe610fda635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:23:45.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:24:45.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] MongoDB starting : pid=26678 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:24:45.725+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:24:45.777+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:24:46.192+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713886:192550][26678:0x7feb36c13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:24:46.192+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:24:46.211+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb35b43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB35B22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB367FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB365F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB362FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB360E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB35ECA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB35B22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB36A03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb35b43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:24:46.212+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:25:45.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] MongoDB starting : pid=26939 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:25:45.349+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:25:45.400+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:25:45.799+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507713945:799397][26939:0x7fd78b113c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:25:45.799+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:25:45.819+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd78a043635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD78A022000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D2B9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD78ACFA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD78AAF6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD78A7FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD78A5E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD78A3CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD78A022000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD78AF03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd78a043635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:25:45.819+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:26:45.197+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] MongoDB starting : pid=27149 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:26:45.204+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:26:45.254+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:26:45.638+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714005:638267][27149:0x7f1862e44c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:26:45.638+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:26:45.657+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1861d74635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1861D53000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A284000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1862A2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1862827000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F186252D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1862318000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18620FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1861D53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1862C34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1861d74635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:26:45.657+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:27:45.784+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:27:45.791+0000 I CONTROL [initandlisten] MongoDB starting : pid=27350 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:27:45.791+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:27:45.792+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:27:45.843+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:27:46.226+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714066:226372][27350:0x7f8994c4ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:27:46.226+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:27:46.237+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8993b7e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8993B5D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8994835000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8994631000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8994337000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8994122000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8993F05000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8993B5D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8994A3E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8993b7e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:27:46.237+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:28:46.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] MongoDB starting : pid=27567 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:28:46.053+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:28:46.103+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:28:46.487+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714126:487139][27567:0x7f935be98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:28:46.487+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:28:46.498+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f935adc8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F935ADA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF322FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F935BA7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F935B87B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F935B581000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F935B36C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F935B14F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F935ADA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F935BC88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f935adc8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:28:46.498+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:29:45.613+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] MongoDB starting : pid=27714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:29:45.621+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:29:45.671+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:29:46.100+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714186:100520][27714:0x7fc80d720c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:29:46.100+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:29:46.120+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc80c650635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC80C62F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C0F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC80D307000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC80D103000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC80CE09000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC80CBF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC80C9D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC80C62F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC80D510000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc80c650635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:29:46.120+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:30:45.236+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] MongoDB starting : pid=28004 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:30:45.244+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:30:45.294+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:30:45.672+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714245:672819][28004:0x7f30e1671c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:30:45.672+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:30:45.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30e05a1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F30E0580000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF777F4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F30E1258000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F30E1054000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F30E0D5A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F30E0B45000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F30E0928000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F30E0580000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F30E1461000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30e05a1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:30:45.692+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:31:45.069+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] MongoDB starting : pid=28209 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:31:45.076+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:31:45.127+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:31:45.553+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714305:553796][28209:0x7f55962cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:31:45.553+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:31:45.578+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55951fd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F55951DC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB00CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5595EB4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5595CB0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F55959B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F55957A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5595584000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F55951DC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F55960BD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55951fd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:31:45.578+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:32:45.695+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:32:45.704+0000 I CONTROL [initandlisten] MongoDB starting : pid=28416 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:32:45.704+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:32:45.704+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:32:45.704+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:32:45.704+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:32:45.705+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:32:45.705+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:32:45.705+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:32:45.705+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:32:45.754+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:32:46.122+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714366:122108][28416:0x7f3be7ae9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:32:46.122+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:32:46.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3be6a19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3BE69F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF604DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BE76D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BE74CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BE71D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BE6FBD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BE6DA0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BE69F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BE78D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3be6a19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:32:46.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:33:45.975+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] MongoDB starting : pid=28623 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:33:45.983+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:33:46.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:33:46.411+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714426:411039][28623:0x7f267babbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:33:46.411+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:33:46.430+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f267a9eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F267A9CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF078FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F267B6A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F267B49E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F267B1A4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F267AF8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F267AD72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F267A9CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F267B8AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f267a9eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:33:46.430+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:34:45.555+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] MongoDB starting : pid=28781 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:34:45.563+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:34:45.612+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:34:45.900+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714485:900904][28781:0x7f541352fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:34:45.900+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:34:45.914+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f541245f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F541243E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15432000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5413116000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5412F12000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5412C18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5412A03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54127E6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F541243E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F541331F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f541245f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:34:45.915+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:35:46.036+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] MongoDB starting : pid=29060 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:35:46.044+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:35:46.094+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:35:46.423+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714546:423567][29060:0x7fb75683dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:35:46.423+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:35:46.436+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb75576d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB75574C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4BF8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB756424000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB756220000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB755F26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB755D11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB755AF4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB75574C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB75662D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb75576d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:35:46.436+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:36:45.880+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] MongoDB starting : pid=29267 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:36:45.888+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:36:45.939+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:36:46.304+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714606:304704][29267:0x7f72413acc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:36:46.304+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:36:46.323+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f72402dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F72402BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A6A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7240F93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7240D8F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7240A95000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7240880000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7240663000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F72402BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F724119C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f72402dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:36:46.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:37:45.443+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] MongoDB starting : pid=29466 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:37:45.451+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:37:45.500+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:37:45.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714665:933956][29466:0x7fe2f1015c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:37:45.934+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:37:45.954+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2eff45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2EFF24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94ED6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2F0BFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2F09F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2F06FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2F04E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2F02CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2EFF24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2F0E05000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2eff45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:37:45.954+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:38:45.680+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] MongoDB starting : pid=29683 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:38:45.687+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:38:45.740+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:38:46.207+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714726:207026][29683:0x7fc9614b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:38:46.207+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:38:46.227+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9603e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9603C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC96109D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC960E99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC960B9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC96098A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC96076D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9603C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9612A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9603e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:38:46.227+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:39:45.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=29828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:39:45.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:39:45.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:39:45.882+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714785:882496][29828:0x7fc72d7c8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:39:45.882+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:39:45.902+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc72c6f8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC72C6D7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC72D3AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC72D1AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC72CEB1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC72CC9C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC72CA7F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC72C6D7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC72D5B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc72c6f8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:39:45.902+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:40:46.030+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=30110 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:40:46.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:40:46.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:40:46.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714846:440548][30110:0x7f229f04ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:40:46.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:40:46.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f229df7a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F229DF59000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F229EC31000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F229EA2D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F229E733000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F229E51E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F229E301000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F229DF59000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F229EE3A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f229df7a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:40:46.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:41:45.835+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] MongoDB starting : pid=30320 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:41:45.842+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:41:45.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:41:46.254+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714906:253994][30320:0x7fb1067e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:41:46.254+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:41:46.273+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb105719635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1056F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25CF3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB1063D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1061CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB105ED2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB105CBD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB105AA0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1056F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB1065D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb105719635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:41:46.273+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:42:45.394+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] MongoDB starting : pid=30538 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:42:45.402+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:42:45.452+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:42:45.844+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507714965:844661][30538:0x7fd721fd9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:42:45.844+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:42:45.865+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd720f09635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD720EE8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3270000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD721BC0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7219BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7216C2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7214AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD721290000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD720EE8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD721DC9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd720f09635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:42:45.865+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:43:45.771+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] MongoDB starting : pid=30752 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:43:45.779+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:43:45.828+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:43:46.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715026:161818][30752:0x7fbe69678c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:43:46.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:43:46.181+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbe685a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBE68587000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBE6925F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBE6905B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBE68D61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBE68B4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBE6892F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBE68587000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBE69468000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbe685a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:43:46.181+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:44:45.309+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:44:45.316+0000 I CONTROL [initandlisten] MongoDB starting : pid=30893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:44:45.316+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:44:45.317+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:44:45.367+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:44:45.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715085:670543][30893:0x7f8886192c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:44:45.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:44:45.684+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88850c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88850A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8885D79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8885B75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F888587B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8885666000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8885449000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88850A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8885F82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88850c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:44:45.684+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:45:45.814+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:45:45.821+0000 I CONTROL [initandlisten] MongoDB starting : pid=31179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:45:45.822+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:45:45.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:45:46.284+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715146:284389][31179:0x7fa9153bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:45:46.284+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:45:46.304+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9142eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9142CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF232FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA914FA2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA914D9E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA914AA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA91488F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA914672000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9142CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9151AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9142eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:45:46.304+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:46:45.734+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] MongoDB starting : pid=31388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:46:45.741+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:46:45.792+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:46:46.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715206:132177][31388:0x7fe1cc25fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:46:46.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:46:46.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1cb18f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1CB16E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1CBE46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1CBC42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1CB948000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1CB733000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1CB516000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1CB16E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1CC04F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1cb18f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:46:46.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:47:45.277+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] MongoDB starting : pid=31593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:47:45.284+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:47:45.333+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:47:45.636+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715265:636231][31593:0x7f1e88e11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:47:45.636+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:47:45.647+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e87d41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E87D20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF893000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E889F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E887F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E884FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E882E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E880C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E87D20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E88C01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e87d41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:47:45.647+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:48:45.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] MongoDB starting : pid=31801 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:48:45.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:48:45.823+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:48:46.175+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715326:175878][31801:0x7f47ce702c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:48:46.175+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:48:46.195+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f47cd632635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47CD611000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F47CE2E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F47CE0E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F47CDDEB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F47CDBD6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47CD9B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47CD611000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47CE4F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f47cd632635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:48:46.195+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:49:45.860+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] MongoDB starting : pid=31936 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:49:45.868+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:49:45.923+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:49:46.328+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715386:328974][31936:0x7fd367693c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:49:46.329+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:49:46.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3665c3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3665A2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD36727A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD367076000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD366D7C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD366B67000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD36694A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3665A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD367483000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3665c3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:49:46.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:50:45.466+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] MongoDB starting : pid=32226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:50:45.473+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:50:45.523+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:50:45.923+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715445:923573][32226:0x7f8ac5244c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:50:45.923+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:50:45.944+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ac4174635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8AC4153000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA9E2C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8AC4E2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8AC4C27000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8AC492D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8AC4718000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8AC44FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8AC4153000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8AC5034000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ac4174635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:50:45.944+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:51:45.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] MongoDB starting : pid=32431 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:51:45.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:51:45.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:51:45.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715505:846039][32431:0x7f870909cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:51:45.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:51:45.856+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8707fcc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8707FAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFECAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8708C83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8708A7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8708785000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8708570000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8708353000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8707FAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8708E8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8707fcc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:51:45.856+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:52:45.993+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=32634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:52:46.001+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:52:46.051+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:52:46.473+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715566:473717][32634:0x7fbaee967c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:52:46.473+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:52:46.493+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbaed897635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAED876000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAEE54E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAEE34A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAEE050000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAEDE3B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAEDC1E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAED876000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAEE757000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbaed897635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:52:46.493+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:53:45.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] MongoDB starting : pid=374 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:53:45.637+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:53:45.687+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:53:46.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715626:52756][374:0x7f3509010c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:53:46.052+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:53:46.065+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3507f40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3507F1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF196FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3508BF7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F35089F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35086F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F35084E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F35082C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3507F1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3508E00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3507f40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:53:46.065+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:54:45.983+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] MongoDB starting : pid=512 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:54:45.990+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:54:46.041+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:54:46.475+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715686:475036][512:0x7f4b873b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:54:46.492+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:54:46.512+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b862e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B862C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A3A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B86F9A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B86D96000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B86A9C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B86887000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B8666A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B862C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B871A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b862e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:54:46.512+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:55:45.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] MongoDB starting : pid=817 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:55:45.641+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:55:45.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:55:46.093+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715746:93243][817:0x7fe69b5b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:55:46.093+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:55:46.103+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe69a4e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE69A4C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE69B19B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE69AF97000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE69AC9D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE69AA88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE69A86B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE69A4C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE69B3A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe69a4e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:55:46.103+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:56:45.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=1020 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:56:45.565+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:56:45.615+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:56:45.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715805:896062][1020:0x7fb051faac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:56:45.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:56:45.915+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb050eda635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB050EB9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF9B94000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB051B91000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB05198D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB051693000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB05147E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB051261000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB050EB9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB051D9A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb050eda635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:56:45.915+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:57:46.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] MongoDB starting : pid=1221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:57:46.041+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:57:46.091+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:57:46.441+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715866:441047][1221:0x7fad50aebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:57:46.441+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:57:46.461+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fad4fa1b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAD4F9FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAD506D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAD504CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAD501D4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAD4FFBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAD4FDA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAD4F9FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAD508DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fad4fa1b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:57:46.461+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:58:45.587+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] MongoDB starting : pid=1436 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:58:45.595+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:58:45.646+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:58:46.106+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715926:106262][1436:0x7f90d3ad0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:58:46.106+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:58:46.125+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90d2a00635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90D29DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90D36B7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90D34B3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90D31B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90D2FA4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90D2D87000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90D29DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90D38C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90d2a00635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:58:46.125+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T09:59:45.321+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=1578 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] modules: none 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] build environment: 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T09:59:45.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T09:59:45.381+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T09:59:45.733+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507715985:733311][1578:0x7f4b4622ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T09:59:45.733+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T09:59:45.744+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b4515e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B4513D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B45E15000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B45C11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B45917000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B45702000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B454E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B4513D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B4601E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b4515e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T09:59:45.744+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:00:45.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=1790 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:00:45.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:00:45.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:00:46.411+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716046:411455][1790:0x7f0cfbb67c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:00:46.411+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:00:46.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0cfaa97635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CFAA76000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF929D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CFB74E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CFB54A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CFB250000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CFB03B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CFAE1E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CFAA76000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CFB957000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0cfaa97635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:00:46.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:01:45.853+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] MongoDB starting : pid=1988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:01:45.861+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:01:45.912+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:01:46.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716106:410752][1988:0x7fc34b579c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:01:46.410+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:01:46.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc34a4a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC34A488000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF906FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC34B160000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC34AF5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC34AC62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC34AA4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC34A830000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC34A488000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC34B369000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc34a4a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:01:46.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:02:45.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=2203 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:02:45.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:02:45.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:02:46.349+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716166:349078][2203:0x7f19bb417c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:02:46.349+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:02:46.368+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19ba347635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19BA326000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF0CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19BAFFE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19BADFA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19BAB00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19BA8EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19BA6CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19BA326000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19BB207000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19ba347635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:02:46.368+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:03:45.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=2406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:03:45.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:03:45.548+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:03:45.947+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716225:947849][2406:0x7fea347c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:03:45.947+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:03:45.967+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea336f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA336D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99888000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA343AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA341A9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA33EAF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA33C9A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA33A7D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA336D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA345B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea336f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:03:45.967+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:04:45.285+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:04:45.292+0000 I CONTROL [initandlisten] MongoDB starting : pid=2632 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:04:45.292+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:04:45.292+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:04:45.292+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:04:45.292+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:04:45.293+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:04:45.293+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:04:45.293+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:04:45.293+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:04:45.342+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:04:45.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716285:741974][2632:0x7ff64c818c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:04:45.742+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:04:45.761+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff64b748635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF64B727000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF64C3FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF64C1FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF64BF01000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF64BCEC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF64BACF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF64B727000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF64C608000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff64b748635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:04:45.761+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:05:45.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=2786 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:05:45.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:05:45.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:05:45.956+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:05:46.374+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716346:374033][2786:0x7fce58facc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:05:46.374+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:05:46.393+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce57edc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE57EBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE61EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE58B93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE5898F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE58695000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE58480000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE58263000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE57EBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE58D9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce57edc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:05:46.393+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:06:45.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=3048 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:06:45.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:06:45.820+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:06:46.265+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716406:265775][3048:0x7fa67fa6fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:06:46.265+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:06:46.290+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa67e99f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA67E97E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC63F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA67F656000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA67F452000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA67F158000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA67EF43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA67ED26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA67E97E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA67F85F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa67e99f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:06:46.290+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:07:45.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] MongoDB starting : pid=3251 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:07:45.417+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:07:45.468+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:07:45.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716465:828159][3251:0x7fcbf0bc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:07:45.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:07:45.840+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbefaf9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBEFAD8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBF07B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBF05AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBF02B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBF009D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBEFE80000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBEFAD8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBF09B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbefaf9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:07:45.841+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:08:45.967+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] MongoDB starting : pid=3475 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:08:45.975+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:08:46.026+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:08:46.446+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716526:446768][3475:0x7fe210b38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:08:46.446+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:08:46.468+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe20fa68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE20FA47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE21071F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE21051B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE210221000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE21000C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE20FDEF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE20FA47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE210928000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe20fa68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:08:46.468+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:09:45.503+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:09:45.513+0000 I CONTROL [initandlisten] MongoDB starting : pid=3701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:09:45.514+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:09:45.565+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:09:45.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716585:963882][3701:0x7f42b0566c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:09:45.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:09:45.979+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f42af496635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F42AF475000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF821A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F42B014D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F42AFF49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F42AFC4F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F42AFA3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F42AF81D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F42AF475000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F42B0356000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f42af496635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:09:45.979+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:10:45.110+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] MongoDB starting : pid=3856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:10:45.118+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:10:45.169+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:10:45.572+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716645:572270][3856:0x7f9357d70c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:10:45.572+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:10:45.593+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9356ca0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9356C7F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF675EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9357957000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9357753000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9357459000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9357244000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9357027000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9356C7F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9357B60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9356ca0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:10:45.593+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:11:45.988+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=4129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:11:45.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:11:46.045+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:11:46.387+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716706:387849][4129:0x7fcf71b27c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:11:46.387+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:11:46.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf70a57635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF70A36000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA23EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF7170E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF7150A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF71210000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF70FFB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF70DDE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF70A36000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF71917000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf70a57635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:11:46.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:12:45.530+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] MongoDB starting : pid=4402 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:12:45.538+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:12:45.588+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:12:46.022+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716766:22427][4402:0x7f9e48fc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:12:46.022+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:12:46.033+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e47ef9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E47ED8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD41E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E48BB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E489AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E486B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E4849D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E48280000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E47ED8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E48DB9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e47ef9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:12:46.033+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:13:45.163+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] MongoDB starting : pid=4621 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:13:45.170+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:13:45.220+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:13:45.593+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716825:593891][4621:0x7fc40b4d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:13:45.593+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:13:45.613+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc40a400635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC40A3DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC40B0B7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC40AEB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC40ABB9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC40A9A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC40A787000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC40A3DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC40B2C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc40a400635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:13:45.613+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:14:45.590+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=4854 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:14:45.598+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:14:45.650+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:14:45.998+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716885:998555][4854:0x7fa3dcde3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:14:45.998+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:14:46.009+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa3dbd13635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3DBCF2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3DC9CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3DC7C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3DC4CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3DC2B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3DC09A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3DBCF2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3DCBD3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa3dbd13635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:14:46.009+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:15:45.138+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:15:45.145+0000 I CONTROL [initandlisten] MongoDB starting : pid=5172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:15:45.145+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:15:45.145+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:15:45.145+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:15:45.146+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:15:45.146+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:15:45.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:15:45.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:15:45.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:15:45.195+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:15:45.592+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507716945:592863][5172:0x7f037f29fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:15:45.592+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:15:45.612+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f037e1cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F037E1AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF550FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F037EE86000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F037EC82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F037E988000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F037E773000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F037E556000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F037E1AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F037F08F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f037e1cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:15:45.612+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:16:46.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=5626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:16:46.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:16:46.063+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:16:46.448+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717006:448460][5626:0x7fd2110b7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:16:46.448+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:16:46.467+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd20ffe7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD20FFC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4E9B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD210C9E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD210A9A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2107A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD21058B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD21036E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD20FFC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD210EA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd20ffe7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:16:46.467+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:17:45.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=5964 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:17:45.601+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:17:45.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:17:46.017+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717066:16993][5964:0x7f0dcc5d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:17:46.017+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:17:46.027+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0dcb507635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0DCB4E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10FC2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0DCC1BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0DCBFBA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0DCBCC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0DCBAAB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0DCB88E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0DCB4E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0DCC3C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0dcb507635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:17:46.027+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:18:45.150+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] MongoDB starting : pid=6290 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:18:45.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:18:45.210+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:18:45.525+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717125:525304][6290:0x7fa996ad7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:18:45.525+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:18:45.535+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa995a07635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9959E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E2CA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9966BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9964BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9961C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA995FAB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA995D8E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9959E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9968C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa995a07635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:18:45.535+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:19:46.025+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:19:46.032+0000 I CONTROL [initandlisten] MongoDB starting : pid=6594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:19:46.032+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:19:46.033+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:19:46.082+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:19:46.527+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717186:527401][6594:0x7f0607254c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:19:46.527+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:19:46.548+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0606184635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0606163000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF258FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0606E3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0606C37000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F060693D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0606728000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F060650B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0606163000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0607044000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0606184635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:19:46.548+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:20:45.674+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:20:45.681+0000 I CONTROL [initandlisten] MongoDB starting : pid=6775 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:20:45.681+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:20:45.682+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:20:45.731+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:20:46.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717246:92972][6775:0x7f964beacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:20:46.093+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:20:46.106+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f964addc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F964ADBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F964BA93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F964B88F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F964B595000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F964B380000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F964B163000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F964ADBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F964BC9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f964addc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:20:46.106+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:21:45.578+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] MongoDB starting : pid=7043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:21:45.586+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:21:45.636+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:21:46.001+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717306:1894][7043:0x7f9d43a0fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:21:46.001+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:21:46.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d4293f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D4291E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAB0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D435F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D433F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D430F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D42EE3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D42CC6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D4291E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D437FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d4293f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:21:46.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:22:45.137+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] MongoDB starting : pid=7249 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:22:45.145+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:22:45.194+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:22:45.582+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717365:582595][7249:0x7f9e3482fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:22:45.582+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:22:45.601+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e3375f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E3373E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD667D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E34416000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E34212000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E33F18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E33D03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E33AE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E3373E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E3461F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e3375f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:22:45.601+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:23:45.741+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] MongoDB starting : pid=7454 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:23:45.748+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:23:45.749+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:23:45.798+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:23:46.151+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717426:151375][7454:0x7fa1e85b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:23:46.151+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:23:46.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1e74e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1E74BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51CD6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1E8197000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1E7F93000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1E7C99000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1E7A84000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1E7867000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1E74BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1E83A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1e74e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:23:46.162+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:24:45.104+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] MongoDB starting : pid=7678 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:24:45.112+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:24:45.161+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:24:45.494+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717485:494409][7678:0x7f985378dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:24:45.494+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:24:45.506+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98526bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F985269C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9853374000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9853170000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9852E76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9852C61000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9852A44000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F985269C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F985357D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98526bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:24:45.506+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:25:45.626+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] MongoDB starting : pid=7832 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:25:45.636+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:25:45.688+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:25:46.124+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717546:124386][7832:0x7fd729530c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:25:46.124+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:25:46.145+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd728460635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD72843F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD729117000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD728F13000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD728C19000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD728A04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7287E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD72843F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD729320000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd728460635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:25:46.146+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:26:45.623+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=8093 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:26:45.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:26:45.679+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:26:46.024+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717606:24254][8093:0x7f33ea342c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:26:46.024+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:26:46.035+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33e9272635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33E9251000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF264FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33E9F29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33E9D25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33E9A2B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33E9816000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33E95F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33E9251000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33EA132000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33e9272635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:26:46.035+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:27:45.162+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] MongoDB starting : pid=8295 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:27:45.170+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:27:45.222+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:27:45.591+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717665:591180][8295:0x7f401c048c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:27:45.591+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:27:45.610+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f401af78635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F401AF57000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F401BC2F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F401BA2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F401B731000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F401B51C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F401B2FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F401AF57000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F401BE38000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f401af78635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:27:45.610+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:28:45.744+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] MongoDB starting : pid=8525 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:28:45.753+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:28:45.803+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:28:46.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717726:152340][8525:0x7fe5a4b2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:28:46.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:28:46.163+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe5a3a5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5A3A3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D8C2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE5A4715000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE5A4511000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE5A4217000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE5A4002000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE5A3DE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5A3A3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE5A491E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe5a3a5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:28:46.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:29:45.219+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] MongoDB starting : pid=8747 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:29:45.228+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:29:45.278+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:29:45.675+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717785:675126][8747:0x7f5be4a3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:29:45.675+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:29:45.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5be396b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5BE394A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF550B6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5BE4622000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5BE441E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5BE4124000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5BE3F0F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5BE3CF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5BE394A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5BE482B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5be396b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:29:45.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:30:45.805+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=8900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:30:45.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:30:45.837+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:30:46.175+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717846:175243][8900:0x7fb616f03c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:30:46.175+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:30:46.189+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb615e33635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB615E12000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB616AEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB6168E6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB6165EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB6163D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB6161BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB615E12000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB616CF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb615e33635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:30:46.189+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:31:45.625+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] MongoDB starting : pid=9153 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:31:45.632+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:31:45.681+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:31:46.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717906:70419][9153:0x7f272e2c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:31:46.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:31:46.089+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f272d1f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F272D1D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3689E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F272DEAC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F272DCA8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F272D9AE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F272D799000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F272D57C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F272D1D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F272E0B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f272d1f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:31:46.090+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:32:45.213+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] MongoDB starting : pid=9356 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:32:45.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:32:45.275+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:32:45.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507717965:668194][9356:0x7f36ee39bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:32:45.668+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:32:45.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36ed2cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36ED2AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16D47000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36EDF82000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36EDD7E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36EDA84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36ED86F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36ED652000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36ED2AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36EE18B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36ed2cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:32:45.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:33:45.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] MongoDB starting : pid=9578 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:33:45.823+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:33:45.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:33:46.219+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718026:219983][9578:0x7f1d78546c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:33:46.220+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:33:46.232+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d77476635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D77455000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92E40000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D7812D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D77F29000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D77C2F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D77A1A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D777FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D77455000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D78336000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d77476635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:33:46.232+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:34:45.650+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] MongoDB starting : pid=9799 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:34:45.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:34:45.707+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:34:46.100+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718086:100192][9799:0x7f10e7a30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:34:46.100+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:34:46.119+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f10e6960635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F10E693F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF910FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10E7617000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10E7413000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10E7119000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10E6F04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10E6CE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F10E693F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F10E7820000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f10e6960635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:34:46.119+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:35:45.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] MongoDB starting : pid=9951 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:35:45.265+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:35:45.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:35:45.710+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718145:710343][9951:0x7fddb98c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:35:45.710+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:35:45.730+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fddb87f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDDB87D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FDDBA1D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDDB94AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDDB92AA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDDB8FB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDDB8D9B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDDB8B7E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDDB87D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDDB96B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fddb87f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:35:45.730+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:36:45.153+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] MongoDB starting : pid=10067 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:36:45.161+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:36:45.212+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:36:45.700+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718205:700372][10067:0x7ff677ce8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:36:45.700+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:36:45.723+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff676c18635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF676BF7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF6778CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF6776CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF6773D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF6771BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF676F9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF676BF7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF677AD8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff676c18635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:36:45.723+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:37:45.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:37:45.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=10321 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:37:45.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:37:45.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:37:45.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:37:45.852+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:37:45.852+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:37:45.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:37:45.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:37:45.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:37:45.901+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:37:46.241+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718266:241598][10321:0x7f74dce82c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:37:46.241+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:37:46.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74dbdb2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74DBD91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000006CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74DCA69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74DC865000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74DC56B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F74DC356000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F74DC139000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74DBD91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74DCC72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74dbdb2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:37:46.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:38:45.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=10532 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:38:45.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:38:45.441+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:38:45.771+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718325:771702][10532:0x7f2957271c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:38:45.771+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:38:45.791+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29561a1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2956180000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD99FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2956E58000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2956C54000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F295695A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2956745000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2956528000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2956180000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2957061000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29561a1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:38:45.791+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:39:45.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=10751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:39:45.674+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:39:45.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:39:46.079+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718386:79883][10751:0x7f2453d66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:39:46.079+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:39:46.090+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2452c96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2452C75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEE8FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F245394D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2453749000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F245344F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F245323A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F245301D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2452C75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2453B56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2452c96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:39:46.090+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:40:45.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=10989 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:40:45.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:40:45.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:40:45.601+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718445:601647][10989:0x7f43cfc86c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:40:45.601+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:40:45.615+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f43cebb6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F43CEB95000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF52AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F43CF86D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F43CF669000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F43CF36F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43CF15A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F43CEF3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F43CEB95000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F43CFA76000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f43cebb6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:40:45.615+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:41:46.036+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] MongoDB starting : pid=11113 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:41:46.044+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:41:46.095+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:41:46.402+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718506:402569][11113:0x7fb41d02bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:41:46.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:41:46.412+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb41bf5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB41BF3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB41CC12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB41CA0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB41C714000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB41C4FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB41C2E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB41BF3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB41CE1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb41bf5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:41:46.413+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:42:45.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] MongoDB starting : pid=11373 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:42:45.542+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:42:45.592+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:42:45.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718565:894437][11373:0x7ff1ea27ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:42:45.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:42:45.905+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1e91ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1E918D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF734F4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF1E9E65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF1E9C61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF1E9967000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1E9752000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1E9535000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1E918D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1EA06E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1e91ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:42:45.905+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:43:46.027+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] MongoDB starting : pid=11586 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:43:46.035+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:43:46.085+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:43:46.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718626:511293][11586:0x7f201709fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:43:46.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:43:46.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2015fcf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2015FAE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF932BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2016C86000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2016A82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2016788000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2016573000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2016356000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2015FAE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2016E8F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2015fcf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:43:46.530+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:44:46.027+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] MongoDB starting : pid=11809 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:44:46.035+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:44:46.085+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:44:46.398+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718686:398027][11809:0x7fef18734c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:44:46.398+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:44:46.408+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef17664635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF17643000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF1831B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF18117000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF17E1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF17C08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF179EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF17643000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF18524000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef17664635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:44:46.408+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:45:45.529+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:45:45.536+0000 I CONTROL [initandlisten] MongoDB starting : pid=12048 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:45:45.536+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:45:45.536+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:45:45.537+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:45:45.537+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:45:45.537+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:45:45.537+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:45:45.537+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:45:45.537+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:45:45.586+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:45:45.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718745:896056][12048:0x7f44dfea9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:45:45.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:45:45.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44dedd9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44DEDB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF190FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44DFA90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44DF88C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44DF592000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44DF37D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44DF160000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44DEDB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44DFC99000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44dedd9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:45:45.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:46:45.289+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] MongoDB starting : pid=12172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:46:45.297+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:46:45.347+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:46:45.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718805:751142][12172:0x7fc15a036c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:46:45.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:46:45.771+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc158f66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC158F45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E54F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC159C1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC159A19000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC15971F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC15950A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC1592ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC158F45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC159E26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc158f66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:46:45.771+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:47:45.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] MongoDB starting : pid=12433 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:47:45.909+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:47:45.959+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:47:46.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718866:296985][12433:0x7f0ca3461c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:47:46.297+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:47:46.307+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ca2391635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CA2370000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CA3048000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CA2E44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CA2B4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CA2935000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CA2718000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CA2370000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CA3251000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ca2391635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:47:46.307+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:48:45.425+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:48:45.432+0000 I CONTROL [initandlisten] MongoDB starting : pid=12641 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:48:45.432+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:48:45.432+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:48:45.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:48:45.433+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:48:45.433+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:48:45.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:48:45.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:48:45.433+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:48:45.483+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:48:45.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718925:782294][12641:0x7f0b34b27c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:48:45.782+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:48:45.792+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0b33a57635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0B33A36000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0B3470E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0B3450A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0B34210000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0B33FFB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0B33DDE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0B33A36000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0B34917000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0b33a57635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:48:45.792+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:49:45.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] MongoDB starting : pid=12860 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:49:45.550+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:49:45.601+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:49:45.907+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507718985:907681][12860:0x7fdee5bf7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:49:45.907+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:49:45.918+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdee4b27635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDEE4B06000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41CB0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDEE57DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDEE55DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDEE52E0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDEE50CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDEE4EAE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDEE4B06000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDEE59E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdee4b27635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:49:45.918+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:50:46.040+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] MongoDB starting : pid=13102 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:50:46.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:50:46.086+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:50:46.413+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719046:413498][13102:0x7fe0f1c72c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:50:46.413+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:50:46.425+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0f0ba2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0F0B81000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5A58000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0F1859000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0F1655000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE0F135B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE0F1146000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE0F0F29000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0F0B81000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0F1A62000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0f0ba2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:50:46.425+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:51:45.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=13226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:51:45.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:51:45.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:51:46.308+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719106:308802][13226:0x7fd9825d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:51:46.308+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:51:46.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd981506635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD9814E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD9821BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD981FB9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD981CBF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD981AAA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD98188D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD9814E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD9823C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd981506635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:51:46.319+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:52:45.445+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] MongoDB starting : pid=13482 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:52:45.453+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:52:45.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:52:45.849+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719165:849347][13482:0x7f8e04a87c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:52:45.849+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:52:45.860+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e039b9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E03998000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F8E05398000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E04670000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E0446C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E04172000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E03F5D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E03D40000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E03998000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E04879000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e039b9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:52:45.860+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:53:45.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=13690 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:53:46.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:53:46.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:53:46.473+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719226:473471][13690:0x7f5791aaec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:53:46.473+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:53:46.493+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f57909de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F57909BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7FFDC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5791695000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5791491000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5791197000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5790F82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5790D65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F57909BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F579189E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f57909de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:53:46.493+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:54:45.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=13909 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:54:45.726+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:54:45.777+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:54:46.131+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719286:131216][13909:0x7fe630106c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:54:46.131+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:54:46.143+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe62f036635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE62F015000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19163000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE62FCED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE62FAE9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE62F7EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE62F5DA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE62F3BD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE62F015000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE62FEF6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe62f036635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:54:46.143+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:55:45.272+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] MongoDB starting : pid=14147 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:55:45.282+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:55:45.334+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:55:45.645+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719345:645415][14147:0x7fb071ab9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:55:45.645+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:55:45.657+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0709e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0709C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9BED7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0716A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB07149C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0711A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB070F8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB070D70000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0709C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0718A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0709e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:55:45.657+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:56:45.064+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] MongoDB starting : pid=14269 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:56:45.072+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:56:45.073+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:56:45.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:56:45.519+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719405:519228][14269:0x7f6a5b548c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:56:45.519+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:56:45.538+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a5a478635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A5A457000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A5B12F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A5AF2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A5AC31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A5AA1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A5A7FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A5A457000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A5B338000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a5a478635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:56:45.538+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:57:45.664+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] MongoDB starting : pid=14837 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:57:45.671+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:57:45.721+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:57:46.033+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719466:33475][14837:0x7f34cd8d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:57:46.033+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:57:46.043+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f34cc808635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F34CC7E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF608FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F34CD4BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34CD2BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34CCFC1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F34CCDAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F34CCB8F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34CC7E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34CD6C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f34cc808635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:57:46.043+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:58:45.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] MongoDB starting : pid=15106 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:58:45.178+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:58:45.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:58:45.236+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:58:45.587+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719525:587259][15106:0x7fd3c53b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:58:45.587+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:58:45.606+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3c42e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3C42C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1445000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3C4F9F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3C4D9B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3C4AA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3C488C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD3C466F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3C42C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3C51A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3c42e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:58:45.606+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T10:59:45.723+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] MongoDB starting : pid=15333 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] modules: none 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] build environment: 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T10:59:45.731+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T10:59:45.782+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T10:59:46.171+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719586:171395][15333:0x7f36f3379c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T10:59:46.171+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T10:59:46.190+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36f22a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36F2288000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF78FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36F2F60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36F2D5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36F2A62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36F284D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36F2630000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36F2288000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36F3169000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36f22a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T10:59:46.190+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:00:45.312+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] MongoDB starting : pid=15589 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:00:45.320+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:00:45.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:00:45.820+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719645:820299][15589:0x7f041f15dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:00:45.820+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:00:45.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f041e08d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F041E06C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3EC8F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F041ED44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F041EB40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F041E846000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F041E631000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F041E414000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F041E06C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F041EF4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f041e08d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:00:45.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:01:45.314+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=15711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:01:45.322+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:01:45.373+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:01:45.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719705:783696][15711:0x7f21a9f2dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:01:45.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:01:45.803+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21a8e5d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21A8E3C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21A9B14000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21A9910000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F21A9616000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F21A9401000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21A91E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21A8E3C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21A9D1D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21a8e5d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:01:45.804+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:02:45.376+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] MongoDB starting : pid=15971 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:02:45.384+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:02:45.435+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:02:45.849+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719765:849903][15971:0x7f30bf3bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:02:45.850+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:02:45.869+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30be2eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F30BE2CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE93D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F30BEFA2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F30BED9E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F30BEAA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F30BE88F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F30BE672000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F30BE2CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F30BF1AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30be2eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:02:45.869+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:03:45.986+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] MongoDB starting : pid=16184 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:03:45.994+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:03:46.045+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:03:46.421+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719826:421922][16184:0x7f3801648c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:03:46.421+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:03:46.432+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3800578635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3800557000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D434000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F380122F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F380102B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3800D31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3800B1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38008FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3800557000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3801438000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3800578635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:03:46.432+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:04:46.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:04:46.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=16398 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:04:46.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:04:46.051+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:04:46.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:04:46.445+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719886:445212][16398:0x7f742fc12c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:04:46.445+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:04:46.455+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f742eb42635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F742EB21000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1124A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F742F7F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F742F5F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F742F2FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F742F0E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F742EEC9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F742EB21000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F742FA02000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f742eb42635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:04:46.455+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:05:45.605+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] MongoDB starting : pid=16643 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:05:45.618+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:05:45.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:05:45.959+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507719945:959914][16643:0x7f5d0e60ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:05:45.959+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:05:45.970+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d0d53a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D0D519000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE86FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D0E1F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D0DFED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D0DCF3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D0DADE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D0D8C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D0D519000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D0E3FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d0d53a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:05:45.970+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:06:45.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:06:45.432+0000 I CONTROL [initandlisten] MongoDB starting : pid=16765 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:06:45.433+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:06:45.488+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:06:45.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720005:784235][16765:0x7fde9c38dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:06:45.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:06:45.795+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde9b2bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE9B29C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE9BF74000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE9BD70000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE9BA76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE9B861000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE9B644000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE9B29C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE9C17D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde9b2bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:06:45.795+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:07:45.931+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] MongoDB starting : pid=17015 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:07:45.938+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:07:45.988+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:07:46.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720066:395724][17015:0x7febeb81ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:07:46.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:07:46.415+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7febea74e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEBEA72D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEBEB405000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEBEB201000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEBEAF07000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEBEACF2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEBEAAD5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEBEA72D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEBEB60E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7febea74e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:07:46.415+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:08:45.544+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] MongoDB starting : pid=17220 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:08:45.555+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:08:45.607+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:08:45.989+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720125:989404][17220:0x7fcfa0db7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:08:45.989+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:08:46.009+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf9fce7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF9FCC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF528FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFA099E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFA079A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFA04A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFA028B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFA006E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF9FCC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFA0BA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf9fce7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:08:46.009+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:09:45.494+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] MongoDB starting : pid=17431 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:09:45.501+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:09:45.554+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:09:45.941+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720185:941793][17431:0x7f7e74f2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:09:45.941+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:09:45.953+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e73e5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E73E3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E74B12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E7490E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E74614000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E743FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E741E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E73E3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E74D1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e73e5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:09:45.953+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:10:45.080+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] MongoDB starting : pid=17678 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:10:45.088+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:10:45.138+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:10:45.576+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720245:576002][17678:0x7f2f70c49c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:10:45.576+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:10:45.595+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f6fb79635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F6FB58000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F70830000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F7062C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F70332000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F7011D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F6FF00000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F6FB58000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F70A39000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f6fb79635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:10:45.596+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:11:46.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] MongoDB starting : pid=17807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:11:46.044+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:11:46.096+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:11:46.436+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720306:436909][17807:0x7f90eca58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:11:46.436+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:11:46.448+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90eb988635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90EB967000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF838FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90EC63F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90EC43B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90EC141000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90EBF2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90EBD0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90EB967000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90EC848000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90eb988635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:11:46.448+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:12:45.577+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] MongoDB starting : pid=17919 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:12:45.585+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:12:45.639+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:12:46.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720366:50068][17919:0x7f7d95e3dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:12:46.050+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:12:46.069+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d94d6d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D94D4C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF59AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D95A24000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D95820000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D95526000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D95311000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D950F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D94D4C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D95C2D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d94d6d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:12:46.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:13:45.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=18190 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:13:45.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:13:45.256+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:13:45.692+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720425:692468][18190:0x7f1dccae6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:13:45.692+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:13:45.716+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dcba16635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DCB9F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF140C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DCC6CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DCC4C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DCC1CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DCBFBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DCBD9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DCB9F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DCC8D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dcba16635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:13:45.716+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:14:45.349+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:14:45.357+0000 I CONTROL [initandlisten] MongoDB starting : pid=18399 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:14:45.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:14:45.409+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:14:45.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720485:805459][18399:0x7f49815aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:14:45.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:14:45.824+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f49804da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F49804B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEF56000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4981191000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4980F8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4980C93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4980A7E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4980861000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F49804B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F498139A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f49804da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:14:45.824+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:15:45.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] MongoDB starting : pid=18652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:15:45.972+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:15:46.028+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:15:46.478+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720546:478612][18652:0x7fdc0d1c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:15:46.478+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:15:46.489+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc0c0f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC0C0CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91732000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC0CDA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC0CBA3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC0C8A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC0C694000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC0C477000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC0C0CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC0CFB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc0c0f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:15:46.489+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:16:45.928+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] MongoDB starting : pid=18857 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:16:45.936+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:16:45.987+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:16:46.322+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720606:322488][18857:0x7fe065817c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:16:46.322+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:16:46.341+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe064747635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE064726000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF086FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0653FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0651FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE064F00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE064CEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE064ACE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE064726000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE065607000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe064747635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:16:46.341+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:17:45.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] MongoDB starting : pid=18973 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:17:45.471+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:17:45.521+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:17:46.014+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720666:14783][18973:0x7f9912534c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:17:46.014+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:17:46.035+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9911464635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9911443000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F991211B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9911F17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9911C1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9911A08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99117EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9911443000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9912324000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9911464635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:17:46.035+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:18:45.172+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] MongoDB starting : pid=19231 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:18:45.180+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:18:45.231+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:18:45.594+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720725:594776][19231:0x7fe143fa6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:18:45.594+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:18:45.605+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe142ed6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE142EB5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DFF1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE143B8D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE143989000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE14368F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE14347A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE14325D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE142EB5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE143D96000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe142ed6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:18:45.605+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:19:45.728+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] MongoDB starting : pid=19442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:19:45.736+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:19:45.797+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:19:46.140+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720786:140255][19442:0x7f22af53cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:19:46.140+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:19:46.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22ae46c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22AE44B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA70FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22AF123000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22AEF1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22AEC25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22AEA10000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22AE7F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22AE44B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22AF32C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22ae46c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:19:46.162+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:20:45.286+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=19680 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:20:45.294+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:20:45.344+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:20:45.622+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720845:622811][19680:0x7f807e052c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:20:45.622+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:20:45.643+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f807cf82635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F807CF61000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2FF25000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F807DC39000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F807DA35000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F807D73B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F807D526000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F807D309000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F807CF61000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F807DE42000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f807cf82635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:20:45.643+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:21:45.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:21:45.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=19896 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:21:45.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:21:45.115+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:21:45.372+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720905:372821][19896:0x7fc3e6f2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:21:45.372+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:21:45.383+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc3e5e5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC3E5E3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF084FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3E6B13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3E690F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3E6615000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3E6400000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3E61E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3E5E3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3E6D1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc3e5e5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:21:45.383+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:22:45.510+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] MongoDB starting : pid=20023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:22:45.519+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:22:45.570+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:22:45.850+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507720965:850690][20023:0x7f56549b1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:22:45.850+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:22:45.861+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56538e1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56538C0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E0AE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5654598000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5654394000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F565409A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5653E85000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5653C68000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56538C0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56547A1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56538e1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:22:45.861+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:23:45.996+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] MongoDB starting : pid=20283 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:23:46.007+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:23:46.057+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:23:46.473+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721026:473313][20283:0x7fcb6949ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:23:46.473+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:23:46.494+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb683ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB683AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32DE4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB69085000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB68E81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB68B87000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB68972000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB68755000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB683AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB6928E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb683ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:23:46.494+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:24:45.621+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=20503 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:24:45.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:24:45.681+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:24:46.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721086:70444][20503:0x7f36b547ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:24:46.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:24:46.090+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36b43ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36B438D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEB8E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36B5065000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36B4E61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36B4B67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36B4952000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36B4735000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36B438D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36B526E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36b43ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:24:46.090+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:25:45.307+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] MongoDB starting : pid=20752 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:25:45.315+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:25:45.365+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:25:45.790+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721145:790704][20752:0x7f19e95e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:25:45.790+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:25:45.810+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19e8513635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19E84F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF07AC7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19E91CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19E8FC6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19E8CCC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19E8AB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19E889A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19E84F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19E93D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19e8513635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:25:45.810+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:26:45.276+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:26:45.284+0000 I CONTROL [initandlisten] MongoDB starting : pid=20997 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:26:45.285+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:26:45.334+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:26:45.692+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721205:692667][20997:0x7fd8415f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:26:45.692+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:26:45.705+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd840522635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD840501000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF858FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD8411D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD840FD5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD840CDB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD840AC6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD8408A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD840501000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8413E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd840522635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:26:45.705+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:27:45.839+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] MongoDB starting : pid=21115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:27:45.847+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:27:45.897+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:27:46.281+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721266:281621][21115:0x7ff82a10fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:27:46.281+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:27:46.293+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff82903f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF82901E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF829CF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF829AF2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8297F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF8295E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF8293C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF82901E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF829EFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff82903f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:27:46.293+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:28:45.413+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:28:45.421+0000 I CONTROL [initandlisten] MongoDB starting : pid=21388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:28:45.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:28:45.474+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:28:45.818+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721325:818406][21388:0x7f7e76286c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:28:45.818+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:28:45.829+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e751b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E75195000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF590FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E75E6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E75C69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E7596F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E7575A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E7553D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E75195000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E76076000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e751b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:28:45.829+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:29:45.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] MongoDB starting : pid=21598 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:29:45.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:29:46.008+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:29:46.299+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721386:299493][21598:0x7f012355ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:29:46.299+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:29:46.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f012248e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F012246D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3404F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0123145000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0122F41000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0122C47000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0122A32000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0122815000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F012246D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F012334E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f012248e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:29:46.319+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:30:45.527+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] MongoDB starting : pid=21844 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:30:45.536+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:30:45.592+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:30:45.992+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721445:991913][21844:0x7f69411afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:30:45.992+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:30:46.012+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f69400df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F69400BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24EB0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6940D96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6940B92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6940898000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6940683000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6940466000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F69400BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6940F9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f69400df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:30:46.012+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:31:45.452+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=22061 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:31:45.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:31:45.510+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:31:45.879+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721505:879464][22061:0x7f7295893c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:31:45.879+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:31:45.899+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f72947c3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F72947A2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF074FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F729547A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7295276000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7294F7C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7294D67000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7294B4A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F72947A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7295683000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f72947c3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:31:45.899+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:32:46.019+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] MongoDB starting : pid=22182 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:32:46.027+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:32:46.076+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:32:46.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721566:408346][22182:0x7fc7b58bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:32:46.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:32:46.419+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7b47eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7B47CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF727AC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7B54A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7B529E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7B4FA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7B4D8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7B4B72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7B47CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7B56AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7b47eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:32:46.419+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:33:45.557+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=22440 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:33:45.565+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:33:45.615+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:33:46.044+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721626:44461][22440:0x7fa521039c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:33:46.044+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:33:46.064+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa51ff69635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA51FF48000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA520C20000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA520A1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA520722000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA52050D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5202F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA51FF48000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA520E29000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa51ff69635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:33:46.064+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:34:45.187+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] MongoDB starting : pid=22649 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:34:45.195+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:34:45.245+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:34:45.543+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721685:543064][22649:0x7f7e988f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:34:45.543+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:34:45.556+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e97826635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E97805000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FA10000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E984DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E982D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E97FDF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E97DCA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E97BAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E97805000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E986E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e97826635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:34:45.556+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:35:45.606+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] MongoDB starting : pid=22889 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:35:45.615+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:35:45.667+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:35:46.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721746:41042][22889:0x7f5a7ba5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:35:46.041+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:35:46.064+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a7a98f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A7A96E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A7B646000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A7B442000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A7B148000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A7AF33000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A7AD16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A7A96E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A7B84F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a7a98f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:35:46.064+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:36:45.530+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] MongoDB starting : pid=23106 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:36:45.537+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:36:45.587+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:36:45.903+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721805:903411][23106:0x7f54103f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:36:45.903+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:36:45.923+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f540f323635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F540F302000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4ECF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F540FFDA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F540FDD6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F540FADC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F540F8C7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F540F6AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F540F302000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54101E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f540f323635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:36:45.923+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:37:45.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=23222 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:37:45.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:37:45.104+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:37:45.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721865:440448][23222:0x7f2bccb47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:37:45.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:37:45.453+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2bcba77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2BCBA56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40C44000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2BCC72E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2BCC52A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2BCC230000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2BCC01B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2BCBDFE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2BCBA56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2BCC937000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2bcba77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:37:45.453+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:38:45.572+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] MongoDB starting : pid=23492 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:38:45.580+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:38:45.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:38:45.978+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721925:978689][23492:0x7f7a43414c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:38:45.978+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:38:45.990+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a42344635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A42323000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A42FFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A42DF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A42AFD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A428E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A426CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A42323000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A43204000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a42344635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:38:45.990+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:39:45.107+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] MongoDB starting : pid=23703 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:39:45.115+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:39:45.167+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:39:45.469+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507721985:469565][23703:0x7fde66d11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:39:45.469+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:39:45.480+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde65c41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE65C20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF697DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE668F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE666F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE663FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE661E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE65FC8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE65C20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE66B01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde65c41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:39:45.480+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:40:45.806+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=23940 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:40:45.814+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:40:45.864+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:40:46.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722046:209594][23940:0x7fbb8c505c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:40:46.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:40:46.221+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb8b435635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB8B414000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB8C0EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB8BEE8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB8BBEE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB8B9D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB8B7BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB8B414000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB8C2F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb8b435635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:40:46.221+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:41:45.612+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] MongoDB starting : pid=24166 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:41:45.620+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:41:45.670+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:41:46.008+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722106:8448][24166:0x7f1b54268c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:41:46.008+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:41:46.018+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b53198635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B53177000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEDABE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B53E4F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B53C4B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B53951000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B5373C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B5351F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B53177000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B54058000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b53198635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:41:46.019+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:42:45.136+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:42:45.143+0000 I CONTROL [initandlisten] MongoDB starting : pid=24288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:42:45.143+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:42:45.143+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:42:45.144+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:42:45.144+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:42:45.144+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:42:45.144+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:42:45.144+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:42:45.144+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:42:45.194+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:42:45.618+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722165:618523][24288:0x7f5b21151c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:42:45.618+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:42:45.637+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5b20081635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5B20060000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF696E4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5B20D38000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5B20B34000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5B2083A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5B20625000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5B20408000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5B20060000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5B20F41000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5b20081635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:42:45.637+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:43:45.755+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] MongoDB starting : pid=24556 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:43:45.762+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:43:45.812+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:43:46.130+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722226:130467][24556:0x7f62b9b58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:43:46.130+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:43:46.141+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62b8a88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62B8A67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D381000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62B973F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62B953B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62B9241000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62B902C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62B8E0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62B8A67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62B9948000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62b8a88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:43:46.141+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:44:45.271+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=24757 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:44:45.278+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:44:45.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:44:45.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:44:45.680+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722285:679998][24757:0x7f8eca6ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:44:45.680+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:44:45.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ec960d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EC95EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C56E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8ECA2C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8ECA0C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EC9DC6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EC9BB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EC9994000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EC95EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8ECA4CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ec960d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:44:45.690+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:45:46.022+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] MongoDB starting : pid=24990 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:45:46.030+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:45:46.080+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:45:46.495+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722346:495458][24990:0x7f1b0dc6ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:45:46.495+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:45:46.515+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b0cb9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B0CB7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF702FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B0D855000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B0D651000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B0D357000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B0D142000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B0CF25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B0CB7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B0DA5E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b0cb9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:45:46.515+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:46:45.983+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] MongoDB starting : pid=25223 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:46:45.991+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:46:46.042+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:46:46.441+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722406:441537][25223:0x7f6815ff2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:46:46.441+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:46:46.462+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6814f22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6814F01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6815BD9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68159D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68156DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68154C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68152A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6814F01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6815DE2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6814f22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:46:46.462+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:47:45.583+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] MongoDB starting : pid=25339 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:47:45.591+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:47:45.641+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:47:46.049+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722466:49766][25339:0x7fa7e268ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:47:46.049+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:47:46.068+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7e15ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7E1599000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7E2271000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7E206D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7E1D73000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7E1B5E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7E1941000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7E1599000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7E247A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7e15ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:47:46.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:48:45.198+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=25454 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:48:45.206+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:48:45.256+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:48:45.681+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722525:681555][25454:0x7fede61b7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:48:45.681+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:48:45.698+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fede50e7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEDE50C6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEDE5D9E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEDE5B9A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEDE58A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEDE568B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEDE546E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEDE50C6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEDE5FA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fede50e7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:48:45.698+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:49:45.830+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] MongoDB starting : pid=25704 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:49:45.837+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:49:45.887+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:49:46.284+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722586:284579][25704:0x7fc60bc9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:49:46.284+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:49:46.303+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc60abcc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC60ABAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC08FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC60B883000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC60B67F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC60B385000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC60B170000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC60AF53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC60ABAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC60BA8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc60abcc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:49:46.303+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:50:45.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] MongoDB starting : pid=25931 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:50:45.997+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:50:46.050+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:50:46.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722646:370972][25931:0x7fbb3eb35c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:50:46.371+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:50:46.381+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb3da65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB3DA44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF978FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB3E71C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB3E518000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB3E21E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB3E009000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB3DDEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB3DA44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB3E925000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb3da65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:50:46.381+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:51:45.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:51:45.733+0000 I CONTROL [initandlisten] MongoDB starting : pid=26179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:51:45.733+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:51:45.733+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:51:45.733+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:51:45.734+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:51:45.734+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:51:45.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:51:45.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:51:45.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:51:45.783+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:51:46.115+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722706:115152][26179:0x7f5d46b3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:51:46.115+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:51:46.125+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d45a6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D45A4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D46725000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D46521000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D46227000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D46012000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D45DF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D45A4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D4692E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d45a6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:51:46.125+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:52:45.247+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] MongoDB starting : pid=26379 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:52:45.255+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:52:45.305+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:52:45.611+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722765:610939][26379:0x7fbc92af9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:52:45.611+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:52:45.630+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc91a29635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC91A08000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F19F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC926E0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC924DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC921E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC91FCD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC91DB0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC91A08000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC928E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc91a29635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:52:45.630+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:53:45.769+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] MongoDB starting : pid=26501 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:53:45.777+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:53:45.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:53:46.224+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722826:224379][26501:0x7f4bec3ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:53:46.224+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:53:46.243+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4beb2fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4BEB2DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEE853000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4BEBFB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4BEBDAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4BEBAB5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4BEB8A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4BEB683000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4BEB2DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4BEC1BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4beb2fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:53:46.243+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:54:45.370+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] MongoDB starting : pid=26755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:54:45.377+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:54:45.427+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:54:45.714+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722885:714113][26755:0x7f1782a4ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:54:45.714+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:54:45.725+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f178197a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1781959000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1782631000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F178242D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1782133000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1781F1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1781D01000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1781959000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F178283A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f178197a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:54:45.725+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:55:45.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=26977 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:55:45.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:55:45.230+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:55:45.658+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507722945:658174][26977:0x7ffd2523ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:55:45.658+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:55:45.678+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd2416e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD2414D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B851000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD24E25000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD24C21000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD24927000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD24712000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD244F5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD2414D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD2502E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd2416e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:55:45.678+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:56:45.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:56:45.122+0000 I CONTROL [initandlisten] MongoDB starting : pid=27224 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:56:45.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:56:45.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:56:45.564+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723005:564512][27224:0x7f39c859fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:56:45.564+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:56:45.575+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39c74cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F39C74AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED647000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39C8186000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39C7F82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39C7C88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39C7A73000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39C7856000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F39C74AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F39C838F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39c74cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:56:45.575+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:57:45.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=27426 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:57:45.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:57:45.765+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:57:46.119+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723066:119204][27426:0x7f801bbf0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:57:46.119+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:57:46.139+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f801ab20635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F801AAFF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE6AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F801B7D7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F801B5D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F801B2D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F801B0C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F801AEA7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F801AAFF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F801B9E0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f801ab20635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:57:46.139+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:58:45.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=27558 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:58:45.278+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:58:45.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:58:45.691+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723125:691571][27558:0x7ff839678c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:58:45.691+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:58:45.713+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8385a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF838587000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF518FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF83925F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF83905B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF838D61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF838B4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF83892F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF838587000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF839468000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8385a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:58:45.713+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T11:59:45.844+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] MongoDB starting : pid=27811 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] modules: none 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] build environment: 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T11:59:45.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T11:59:45.903+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T11:59:46.302+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723186:302713][27811:0x7f3c172e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T11:59:46.302+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T11:59:46.321+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c16217635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C161F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C16ECE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C16CCA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C169D0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C167BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C1659E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C161F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C170D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c16217635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T11:59:46.322+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:00:45.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] MongoDB starting : pid=28089 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:00:45.250+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:00:45.311+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:00:45.704+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723245:704648][28089:0x7fd106ecec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:00:45.704+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:00:45.715+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd105dfe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD105DDD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36EEF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD106AB5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD1068B1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD1065B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD1063A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD106185000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD105DDD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD106CBE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd105dfe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:00:45.715+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:01:45.183+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:01:45.190+0000 I CONTROL [initandlisten] MongoDB starting : pid=28332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:01:45.190+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:01:45.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:01:45.191+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:01:45.191+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:01:45.191+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:01:45.191+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:01:45.191+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:01:45.191+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:01:45.243+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:01:45.712+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723305:712356][28332:0x7f46b4883c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:01:45.712+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:01:45.731+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f46b37b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F46B3792000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF604FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F46B446A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F46B4266000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F46B3F6C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F46B3D57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F46B3B3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F46B3792000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F46B4673000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f46b37b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:01:45.732+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:02:45.122+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] MongoDB starting : pid=28539 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:02:45.129+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:02:45.180+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:02:45.496+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723365:496778][28539:0x7fd2dd1bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:02:45.496+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:02:45.507+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd2dc0ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD2DC0CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2DCDA3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2DCB9F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2DC8A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD2DC690000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD2DC473000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD2DC0CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2DCFAC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd2dc0ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:02:45.507+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:03:45.639+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:03:45.647+0000 I CONTROL [initandlisten] MongoDB starting : pid=28663 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:03:45.648+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:03:45.702+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:03:46.148+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723426:148052][28663:0x7f9bb4725c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:03:46.148+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:03:46.167+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9bb3655635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9BB3634000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF34FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9BB430C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9BB4108000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9BB3E0E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9BB3BF9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9BB39DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9BB3634000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9BB4515000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9bb3655635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:03:46.167+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:04:45.295+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] MongoDB starting : pid=28925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:04:45.304+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:04:45.357+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:04:45.748+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723485:748074][28925:0x7f90a61a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:04:45.748+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:04:45.769+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90a50d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90A50B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF941F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90A5D8A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90A5B86000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90A588C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90A5677000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90A545A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90A50B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90A5F93000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90a50d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:04:45.769+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:05:45.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] MongoDB starting : pid=29146 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:05:45.550+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:05:45.600+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:05:45.955+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723545:955714][29146:0x7f637ce62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:05:45.955+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:05:45.966+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f637bd92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F637BD71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBB71000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F637CA49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F637C845000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F637C54B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F637C336000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F637C119000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F637BD71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F637CC52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f637bd92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:05:45.966+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:06:45.387+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] MongoDB starting : pid=29392 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:06:45.395+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:06:45.445+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:06:45.756+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723605:756299][29392:0x7f78ccff2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:06:45.756+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:06:45.766+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78cbf22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78CBF01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1636F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78CCBD9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78CC9D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78CC6DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78CC4C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78CC2A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78CBF01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78CCDE2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78cbf22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:06:45.766+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:07:45.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] MongoDB starting : pid=29591 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:07:45.891+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:07:45.941+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:07:46.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723666:274474][29591:0x7fe433291c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:07:46.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:07:46.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4321c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4321A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA1EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE432E78000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE432C74000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE43297A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE432765000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE432548000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4321A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE433081000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4321c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:07:46.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:08:45.400+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] MongoDB starting : pid=29713 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:08:45.409+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:08:45.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:08:45.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723725:805437][29713:0x7fba2fa69c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:08:45.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:08:45.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba2e999635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA2E978000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF353F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA2F650000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA2F44C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA2F152000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA2EF3D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA2ED20000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA2E978000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA2F859000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba2e999635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:08:45.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:09:45.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] MongoDB starting : pid=29965 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:09:45.954+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:09:45.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:09:46.004+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:09:46.427+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723786:427634][29965:0x7f7d330aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:09:46.427+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:09:46.447+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d31fde635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D31FBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF974FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D32C95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D32A91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D32797000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D32582000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D32365000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D31FBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D32E9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d31fde635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:09:46.447+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:10:45.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:10:45.629+0000 I CONTROL [initandlisten] MongoDB starting : pid=30185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:10:45.629+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:10:45.629+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:10:45.629+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:10:45.629+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:10:45.630+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:10:45.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:10:45.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:10:45.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:10:45.680+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:10:46.042+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723846:42528][30185:0x7f21e6a74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:10:46.042+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:10:46.053+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21e59a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21E5983000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21E665B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21E6457000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F21E615D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F21E5F48000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21E5D2B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21E5983000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21E6864000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21e59a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:10:46.053+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:11:45.474+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:11:45.481+0000 I CONTROL [initandlisten] MongoDB starting : pid=30434 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:11:45.481+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:11:45.481+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:11:45.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:11:45.482+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:11:45.482+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:11:45.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:11:45.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:11:45.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:11:45.532+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:11:45.871+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723905:871267][30434:0x7f6084e38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:11:45.871+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:11:45.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6083d68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6083D47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7FCD6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6084A1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F608481B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6084521000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F608430C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F60840EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6083D47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6084C28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6083d68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:11:45.884+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:12:46.010+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] MongoDB starting : pid=30713 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:12:46.018+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:12:46.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:12:46.437+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507723966:437251][30713:0x7fe2c1a1fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:12:46.437+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:12:46.448+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2c094f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2C092E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF22EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2C1606000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2C1402000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2C1108000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2C0EF3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2C0CD6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2C092E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2C180F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2c094f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:12:46.448+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:13:45.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] MongoDB starting : pid=30845 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:13:45.579+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:13:45.628+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:13:45.946+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724025:946365][30845:0x7fa0d496fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:13:45.946+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:13:45.965+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa0d389f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA0D387E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA0D4556000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA0D4352000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA0D4058000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA0D3E43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA0D3C26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA0D387E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA0D475F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa0d389f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:13:45.965+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:14:45.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] MongoDB starting : pid=31117 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:14:45.099+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:14:45.149+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:14:45.476+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724085:476642][31117:0x7f9b88faec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:14:45.476+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:14:45.496+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b87ede635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B87EBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A597000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B88B95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B88991000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B88697000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B88482000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B88265000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B87EBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B88D9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b87ede635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:14:45.496+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:15:45.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=31360 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:15:45.798+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:15:45.848+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:15:46.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724146:129444][31360:0x7f6dd58d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:15:46.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:15:46.140+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6dd4808635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6DD47E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6DD54BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6DD52BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6DD4FC1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6DD4DAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6DD4B8F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6DD47E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6DD56C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6dd4808635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:15:46.140+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:16:45.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] MongoDB starting : pid=31622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:16:45.557+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:16:45.608+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:16:45.921+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724205:921007][31622:0x7f745f611c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:16:45.921+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:16:45.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f745e541635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F745E520000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF522FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F745F1F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F745EFF4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F745ECFA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F745EAE5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F745E8C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F745E520000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F745F401000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f745e541635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:16:45.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:17:45.062+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] MongoDB starting : pid=31822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:17:45.069+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:17:45.122+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:17:45.419+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724265:419809][31822:0x7f0adac44c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:17:45.419+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:17:45.430+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ad9b74635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0AD9B53000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0ADA82B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0ADA627000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0ADA32D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0ADA118000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0AD9EFB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0AD9B53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0ADAA34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ad9b74635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:17:45.430+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:18:45.569+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:18:45.576+0000 I CONTROL [initandlisten] MongoDB starting : pid=31947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:18:45.576+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:18:45.576+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:18:45.576+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:18:45.577+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:18:45.577+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:18:45.577+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:18:45.577+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:18:45.577+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:18:45.627+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:18:45.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724325:910711][31947:0x7f8b741fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:18:45.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:18:45.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b7312d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B7310C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF57EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B73DE4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B73BE0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B738E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B736D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B734B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B7310C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B73FED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b7312d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:18:45.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:19:46.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=32198 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:19:46.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:19:46.099+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:19:46.399+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724386:399471][32198:0x7fde5acfac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:19:46.399+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:19:46.410+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde59c2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE59C09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE5A8E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE5A6DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE5A3E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE5A1CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE59FB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE59C09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE5AAEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde59c2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:19:46.410+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:20:45.145+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] MongoDB starting : pid=32417 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:20:45.153+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:20:45.203+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:20:45.437+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724445:437176][32417:0x7fd025f5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:20:45.437+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:20:45.448+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd024e8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD024E6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD025B42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD02593E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD025644000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD02542F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD025212000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD024E6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD025D4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd024e8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:20:45.448+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:21:45.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:21:45.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=32660 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:21:45.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:21:45.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:21:45.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:21:45.850+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:21:45.850+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:21:45.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:21:45.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:21:45.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:21:45.901+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:21:46.184+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724506:184428][32660:0x7f0025f3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:21:46.184+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:21:46.195+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0024e6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0024E49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF280FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0025B21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F002591D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0025623000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F002540E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00251F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0024E49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0025D2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0024e6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:21:46.195+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:22:45.313+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] MongoDB starting : pid=389 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:22:45.321+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:22:45.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:22:45.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724565:662914][389:0x7f02efea0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:22:45.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:22:45.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f02eedd0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F02EEDAF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD12FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F02EFA87000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F02EF883000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F02EF589000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02EF374000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02EF157000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F02EEDAF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F02EFC90000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f02eedd0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:22:45.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:23:45.801+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=517 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:23:45.809+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:23:45.859+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:23:46.156+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724626:156836][517:0x7f80fdfa0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:23:46.156+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:23:46.167+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80fced0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80FCEAF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80FDB87000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80FD983000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80FD689000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80FD474000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80FD257000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80FCEAF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80FDD90000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80fced0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:23:46.167+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:24:45.295+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] MongoDB starting : pid=628 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:24:45.302+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:24:45.351+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:24:45.653+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724685:653333][628:0x7fe8daa5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:24:45.653+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:24:45.664+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe8d998d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE8D996C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD6CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE8DA644000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE8DA440000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE8DA146000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE8D9F31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE8D9D14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE8D996C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE8DA84D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe8d998d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:24:45.664+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:25:45.206+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] MongoDB starting : pid=897 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:25:45.214+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:25:45.264+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:25:45.582+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724745:582035][897:0x7fe325dd7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:25:45.582+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:25:45.601+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe324d07635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE324CE6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5650000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE3259BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE3257BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE3254C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE3252AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE32508E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE324CE6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE325BC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe324d07635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:25:45.601+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:26:45.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:26:45.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=1142 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:26:45.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:26:45.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:26:45.999+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:26:45.999+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:26:45.999+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:26:45.999+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:26:45.999+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:26:45.999+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:26:46.048+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:26:46.382+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724806:382566][1142:0x7f947077fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:26:46.382+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:26:46.394+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f946f6b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F946F690000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F9471090000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9470368000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9470164000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F946FE6A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F946FC55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F946FA38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F946F690000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9470571000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f946f6b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:26:46.394+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:27:45.519+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] MongoDB starting : pid=1343 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:27:45.526+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:27:45.577+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:27:45.918+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724865:918382][1343:0x7fd9734f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:27:45.918+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:27:45.929+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd972421635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD972400000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74609000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD9730D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD972ED4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD972BDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD9729C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD9727A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD972400000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD9732E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd972421635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:27:45.929+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:28:45.051+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] MongoDB starting : pid=1559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:28:45.059+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:28:45.109+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:28:45.516+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724925:516738][1559:0x7f981812ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:28:45.516+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:28:45.536+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f981705e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F981703D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9817D15000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9817B11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9817817000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9817602000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98173E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F981703D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9817F1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f981705e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:28:45.536+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:29:45.666+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=1677 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:29:45.674+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:29:45.723+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:29:46.059+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507724986:59305][1677:0x7f18880f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:29:46.059+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:29:46.069+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1887024635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1887003000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A884000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1887CDB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1887AD7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18877DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18875C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18873AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1887003000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1887EE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1887024635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:29:46.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:30:45.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=1970 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:30:45.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:30:45.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:30:46.048+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725046:48070][1970:0x7f9e75a1ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:30:46.048+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:30:46.058+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e7494a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E74929000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBADCC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E75601000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E753FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E75103000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E74EEE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E74CD1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E74929000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E7580A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e7494a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:30:46.058+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:31:45.453+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] MongoDB starting : pid=2219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:31:45.461+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:31:45.510+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:31:45.833+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725105:833684][2219:0x7f25a4756c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:31:45.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:31:45.845+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25a3686635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25A3665000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF671000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25A433D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F25A4139000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25A3E3F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25A3C2A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25A3A0D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25A3665000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25A4546000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25a3686635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:31:45.845+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:32:45.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:32:45.977+0000 I CONTROL [initandlisten] MongoDB starting : pid=2422 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:32:45.978+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:32:46.040+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:32:46.442+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725166:442312][2422:0x7f654a8efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:32:46.442+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:32:46.462+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f654981f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65497FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD604000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F654A4D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F654A2D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6549FD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6549DC3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6549BA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65497FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F654A6DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f654981f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:32:46.462+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:33:45.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:33:45.593+0000 I CONTROL [initandlisten] MongoDB starting : pid=2634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:33:45.593+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:33:45.593+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:33:45.593+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:33:45.593+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:33:45.594+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:33:45.594+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:33:45.594+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:33:45.594+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:33:45.644+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:33:45.936+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725225:936425][2634:0x7ff7a2635c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:33:45.936+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:33:45.946+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff7a1565635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF7A1544000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF7A221C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF7A2018000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF7A1D1E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF7A1B09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF7A18EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF7A1544000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF7A2425000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff7a1565635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:33:45.946+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:34:45.068+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:34:45.075+0000 I CONTROL [initandlisten] MongoDB starting : pid=2751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:34:45.075+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:34:45.075+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:34:45.076+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:34:45.076+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:34:45.076+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:34:45.076+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:34:45.076+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:34:45.076+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:34:45.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:34:45.499+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725285:499801][2751:0x7fd81317fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:34:45.499+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:34:45.519+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8120af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD81208E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDDEFA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD812D66000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD812B62000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD812868000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD812653000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD812436000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD81208E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD812F6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8120af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:34:45.519+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:35:45.810+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=3028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:35:45.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:35:45.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:35:46.182+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725346:182399][3028:0x7f1880ab3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:35:46.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:35:46.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f187f9e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F187F9C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F188069A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1880496000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F188019C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F187FF87000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F187FD6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F187F9C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18808A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f187f9e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:35:46.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:36:45.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:36:45.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=3274 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:36:45.675+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:36:45.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:36:45.990+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725405:990018][3274:0x7faf49dd1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:36:45.990+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:36:46.000+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf48d01635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF48CE0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BB77000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF499B8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF497B4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF494BA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF492A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF49088000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF48CE0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF49BC1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf48d01635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:36:46.000+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:37:45.127+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:37:45.134+0000 I CONTROL [initandlisten] MongoDB starting : pid=3480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:37:45.134+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:37:45.134+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:37:45.134+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:37:45.135+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:37:45.135+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:37:45.135+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:37:45.135+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:37:45.135+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:37:45.198+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:37:45.453+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725465:453553][3480:0x7f205eba1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:37:45.453+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:37:45.463+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f205dad1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F205DAB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF6A7D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F205E788000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F205E584000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F205E28A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F205E075000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F205DE58000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F205DAB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F205E991000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f205dad1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:37:45.464+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:38:45.577+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] MongoDB starting : pid=3695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:38:45.585+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:38:45.635+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:38:45.983+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725525:983303][3695:0x7fafad4bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:38:45.983+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:38:45.993+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fafac3ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAFAC3CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDEC60000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAFAD0A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAFACEA0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAFACBA6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAFAC991000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAFAC774000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAFAC3CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAFAD2AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fafac3ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:38:45.993+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:39:45.132+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] MongoDB starting : pid=3811 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:39:45.140+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:39:45.190+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:39:45.523+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725585:523727][3811:0x7f555e02cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:39:45.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:39:45.535+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f555cf5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F555CF3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF812FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F555DC13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F555DA0F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F555D715000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F555D500000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F555D2E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F555CF3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F555DE1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f555cf5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:39:45.535+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:40:45.879+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=4088 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:40:45.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:40:45.936+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:40:46.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725646:306657][4088:0x7f014ec7fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:40:46.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:40:46.317+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f014dbaf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F014DB8E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC303E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F014E866000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F014E662000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F014E368000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F014E153000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F014DF36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F014DB8E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F014EA6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f014dbaf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:40:46.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:41:45.718+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=4337 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:41:45.726+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:41:45.776+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:41:46.115+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725706:115772][4337:0x7f973cdd7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:41:46.115+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:41:46.126+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f973bd07635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F973BCE6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB558000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F973C9BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F973C7BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F973C4C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F973C2AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F973C08E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F973BCE6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F973CBC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f973bd07635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:41:46.126+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:42:45.256+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] MongoDB starting : pid=4553 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:42:45.264+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:42:45.325+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:42:45.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725765:674600][4553:0x7f54dfd96c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:42:45.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:42:45.686+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54decc6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54DECA5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF137E9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54DF97D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54DF779000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F54DF47F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54DF26A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54DF04D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54DECA5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54DFB86000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54decc6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:42:45.686+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:43:45.808+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:43:45.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=4788 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:43:45.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:43:45.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:43:45.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:43:45.815+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:43:45.815+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:43:45.816+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:43:45.816+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:43:45.816+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:43:45.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:43:46.199+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725826:199353][4788:0x7febe76f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:43:46.199+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:43:46.210+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7febe6623635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEBE6602000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEBE72DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEBE70D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEBE6DDC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEBE6BC7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEBE69AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEBE6602000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEBE74E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7febe6623635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:43:46.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:44:45.326+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:44:45.334+0000 I CONTROL [initandlisten] MongoDB starting : pid=4913 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:44:45.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:44:45.385+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:44:45.766+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725885:766090][4913:0x7f5eee36cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:44:45.766+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:44:45.785+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5eed29c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5EED27B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EEDF53000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EEDD4F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EEDA55000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5EED840000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5EED623000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5EED27B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EEE15C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5eed29c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:44:45.785+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:45:45.912+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:45:45.919+0000 I CONTROL [initandlisten] MongoDB starting : pid=5444 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:45:45.920+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:45:45.969+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:45:46.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507725946:305861][5444:0x7f36a6f8ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:45:46.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:45:46.316+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36a5eba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36A5E99000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36A6B71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36A696D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36A6673000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36A645E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36A6241000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36A5E99000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36A6D7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36a5eba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:45:46.316+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:46:45.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=5826 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:46:45.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:46:45.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:46:46.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726006:132071][5826:0x7ffe17078c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:46:46.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:46:46.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe15fa8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE15F87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1AE7D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE16C5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE16A5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE16761000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE1654C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE1632F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE15F87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE16E68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe15fa8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:46:46.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:47:45.260+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] MongoDB starting : pid=6140 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:47:45.268+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:47:45.319+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:47:45.604+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726065:604441][6140:0x7f8452f46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:47:45.604+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:47:45.619+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8451e76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8451E55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF026FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8452B2D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8452929000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F845262F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F845241A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84521FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8451E55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8452D36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8451e76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:47:45.619+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:48:45.745+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] MongoDB starting : pid=6491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:48:45.755+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:48:45.805+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:48:46.157+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726126:157182][6491:0x7fa143bd9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:48:46.157+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:48:46.168+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa142b09635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA142AE8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD6A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1437C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1435BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1432C2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1430AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA142E90000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA142AE8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1439C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa142b09635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:48:46.168+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:49:45.295+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] MongoDB starting : pid=6609 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:49:45.302+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:49:45.353+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:49:45.626+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726185:626279][6609:0x7f618599bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:49:45.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:49:45.637+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61848cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61848AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF67CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6185582000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F618537E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6185084000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6184E6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6184C52000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61848AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F618578B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61848cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:49:45.637+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:50:46.002+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] MongoDB starting : pid=6912 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:50:46.010+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:50:46.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:50:46.061+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:50:46.352+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726246:352401][6912:0x7f54144d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:50:46.352+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:50:46.362+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5413406635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54133E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54140BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5413EB9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5413BBF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54139AA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F541378D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54133E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54142C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5413406635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:50:46.362+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:51:45.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] MongoDB starting : pid=7164 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:51:45.832+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:51:45.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:51:46.197+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726306:197972][7164:0x7f2efb286c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:51:46.198+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:51:46.208+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2efa1b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2EFA195000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF82FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2EFAE6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2EFAC69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2EFA96F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2EFA75A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2EFA53D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2EFA195000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2EFB076000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2efa1b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:51:46.208+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:52:45.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] MongoDB starting : pid=7369 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:52:45.347+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:52:45.397+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:52:45.676+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726365:676214][7369:0x7f1848ea1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:52:45.676+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:52:45.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1847dd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1847DB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF149E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1848A88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1848884000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F184858A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1848375000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1848158000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1847DB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1848C91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1847dd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:52:45.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:53:45.807+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=7586 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:53:45.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:53:45.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:53:46.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726426:132111][7586:0x7f5d40e84c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:53:46.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:53:46.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d3fdb4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D3FD93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86A80000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D40A6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D40867000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D4056D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D40358000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D4013B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D3FD93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D40C74000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d3fdb4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:53:46.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:54:45.281+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] MongoDB starting : pid=7714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:54:45.289+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:54:45.341+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:54:45.732+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726485:732850][7714:0x7faa7ed5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:54:45.732+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:54:45.752+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa7dc8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA7DC6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13FB9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA7E944000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA7E740000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA7E446000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA7E231000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA7E014000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA7DC6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA7EB4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa7dc8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:54:45.752+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:55:45.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:55:45.894+0000 I CONTROL [initandlisten] MongoDB starting : pid=7993 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:55:45.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:55:45.945+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:55:46.335+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726546:335239][7993:0x7f8237f9ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:55:46.335+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:55:46.345+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8236eca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8236EA9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8237B81000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F823797D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8237683000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F823746E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8237251000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8236EA9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8237D8A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8236eca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:55:46.345+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:56:45.821+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] MongoDB starting : pid=8229 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:56:45.828+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:56:45.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:56:46.163+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726606:163707][8229:0x7f51e8c68c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:56:46.163+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:56:46.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51e7b98635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51E7B77000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF392FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51E884F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51E864B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51E8351000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51E813C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51E7F1F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51E7B77000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51E8A58000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51e7b98635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:56:46.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:57:45.318+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] MongoDB starting : pid=8438 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:57:45.328+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:57:45.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:57:45.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726665:741724][8438:0x7f61c4223c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:57:45.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:57:45.752+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61c3153635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61C3132000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61C3E0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61C3C06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61C390C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61C36F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61C34DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61C3132000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61C4013000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61c3153635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:57:45.752+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:58:45.859+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:58:45.863+0000 I CONTROL [initandlisten] MongoDB starting : pid=8671 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:58:45.863+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:58:45.863+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:58:45.863+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:58:45.863+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:58:45.864+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:58:45.864+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:58:45.864+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:58:45.864+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:58:45.891+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:58:46.165+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726726:165080][8671:0x7f17fe250c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:58:46.165+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:58:46.176+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f17fd180635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F17FD15F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03CC0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F17FDE37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17FDC33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17FD939000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17FD724000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17FD507000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F17FD15F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F17FE040000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f17fd180635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:58:46.176+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T12:59:45.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] MongoDB starting : pid=8785 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] modules: none 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] build environment: 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T12:59:45.307+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T12:59:45.358+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T12:59:45.749+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726785:749214][8785:0x7f21f2a95c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T12:59:45.749+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T12:59:45.768+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21f19c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21F19A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C2FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21F267C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21F2478000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F21F217E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F21F1F69000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21F1D4C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21F19A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21F2885000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21f19c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T12:59:45.769+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:00:45.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=8936 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:00:45.910+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:00:45.960+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:00:46.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726846:275990][8936:0x7fe5055e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:00:46.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:00:46.287+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe504519635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5044F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE5051D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE504FCC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE504CD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE504ABD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE5048A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5044F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE5053D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe504519635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:00:46.287+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:01:45.494+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] MongoDB starting : pid=9200 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:01:45.502+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:01:45.552+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:01:45.847+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726905:847285][9200:0x7f7a19ce3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:01:45.847+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:01:45.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a18c13635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A18BF2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4468C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A198CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A196C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A193CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A191B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A18F9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A18BF2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A19AD3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a18c13635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:01:45.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:02:45.278+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] MongoDB starting : pid=9418 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:02:45.285+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:02:45.335+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:02:45.708+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507726965:708576][9418:0x7f653c21bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:02:45.708+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:02:45.727+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f653b14b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F653B12A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF57CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F653BE02000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F653BBFE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F653B904000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F653B6EF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F653B4D2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F653B12A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F653C00B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f653b14b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:02:45.728+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:03:45.846+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] MongoDB starting : pid=9626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:03:45.854+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:03:45.904+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:03:46.213+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727026:213813][9626:0x7f0c0b3a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:03:46.213+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:03:46.224+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c0a2d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C0A2B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF07EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C0AF8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C0AD8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C0AA91000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C0A87C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C0A65F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C0A2B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C0B198000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c0a2d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:03:46.224+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:04:45.354+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] MongoDB starting : pid=9826 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:04:45.362+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:04:45.413+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:04:45.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727085:783688][9826:0x7f873b2c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:04:45.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:04:45.803+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f873a1f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F873A1D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F873AEAD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F873ACA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F873A9AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F873A79A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F873A57D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F873A1D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F873B0B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f873a1f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:04:45.803+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:05:45.930+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] MongoDB starting : pid=9963 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:05:45.938+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:05:45.988+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:05:46.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727146:261100][9963:0x7f1455aa0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:05:46.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:05:46.271+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14549d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14549AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1455687000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1455483000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1455189000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1454F74000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1454D57000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14549AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1455890000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14549d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:05:46.271+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:06:45.786+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:06:45.793+0000 I CONTROL [initandlisten] MongoDB starting : pid=10252 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:06:45.794+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:06:45.844+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:06:46.127+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727206:127599][10252:0x7f020a518c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:06:46.127+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:06:46.138+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0209448635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0209427000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76994000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F020A0FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0209EFB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0209C01000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02099EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02097CF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0209427000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F020A308000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0209448635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:06:46.138+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:07:45.275+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] MongoDB starting : pid=10465 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:07:45.282+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:07:45.333+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:07:45.616+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727265:616574][10465:0x7f102836ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:07:45.616+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:07:45.627+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f102729e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F102727D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1027F55000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1027D51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1027A57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1027842000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1027625000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F102727D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F102815E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f102729e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:07:45.627+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:08:45.745+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] MongoDB starting : pid=10682 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:08:45.753+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:08:45.803+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:08:46.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727326:152505][10682:0x7f6468a8ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:08:46.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:08:46.163+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f64679ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6467999000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD54FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6468671000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F646846D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6468173000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6467F5E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6467D41000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6467999000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F646887A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f64679ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:08:46.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:09:45.293+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] MongoDB starting : pid=10883 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:09:45.302+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:09:45.352+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:09:45.689+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727385:689634][10883:0x7f045d779c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:09:45.689+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:09:45.700+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f045c6a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F045C688000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F045D360000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F045D15C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F045CE62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F045CC4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F045CA30000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F045C688000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F045D569000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f045c6a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:09:45.700+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:10:45.828+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] MongoDB starting : pid=11021 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:10:45.836+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:10:45.885+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:10:46.174+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727446:174956][11021:0x7f48f2bcac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:10:46.175+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:10:46.185+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f48f1afa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F48F1AD9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F48F27B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F48F25AD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F48F22B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F48F209E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F48F1E81000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F48F1AD9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F48F29BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f48f1afa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:10:46.185+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:11:45.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] MongoDB starting : pid=11318 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:11:45.769+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:11:45.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:11:46.214+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727506:214803][11318:0x7f87c962bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:11:46.214+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:11:46.234+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f87c855b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87C853A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F87C9212000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F87C900E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F87C8D14000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F87C8AFF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F87C88E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87C853A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87C941B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f87c855b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:11:46.234+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:12:45.359+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] MongoDB starting : pid=11532 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:12:45.367+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:12:45.417+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:12:45.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727565:805035][11532:0x7f83f2783c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:12:45.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:12:45.816+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83f16b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83F1692000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83F236A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83F2166000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83F1E6C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83F1C57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83F1A3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83F1692000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83F2573000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83f16b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:12:45.816+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:13:45.957+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:13:45.964+0000 I CONTROL [initandlisten] MongoDB starting : pid=11747 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:13:45.964+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:13:45.964+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:13:45.964+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:13:45.964+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:13:45.965+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:13:45.965+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:13:45.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:13:45.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:13:46.015+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:13:46.297+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727626:297865][11747:0x7f0fd8b83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:13:46.297+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:13:46.308+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fd7ab3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FD7A92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBBAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FD876A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FD8566000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FD826C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FD8057000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FD7E3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FD7A92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FD8973000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fd7ab3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:13:46.308+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:14:45.437+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] MongoDB starting : pid=11950 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:14:45.446+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:14:45.497+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:14:45.758+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727685:758190][11950:0x7f1091915c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:14:45.758+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:14:45.768+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1090845635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1090824000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF334EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10914FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10912F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1090FFE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1090DE9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1090BCC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1090824000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1091705000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1090845635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:14:45.768+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:15:45.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] MongoDB starting : pid=12090 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:15:45.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:15:45.945+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:15:46.351+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727746:351250][12090:0x7f8a15910c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:15:46.351+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:15:46.370+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8a14840635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8A1481F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8A154F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8A152F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8A14FF9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8A14DE4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8A14BC7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8A1481F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8A15700000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8a14840635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:15:46.370+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:16:45.882+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=12385 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:16:45.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:16:45.939+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:16:46.293+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727806:293708][12385:0x7f0ffeaeec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:16:46.293+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:16:46.304+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ffda1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FFD9FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE863000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FFE6D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FFE4D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FFE1D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FFDFC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FFDDA5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FFD9FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FFE8DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ffda1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:16:46.304+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:17:45.443+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] MongoDB starting : pid=12596 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:17:45.451+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:17:45.501+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:17:45.800+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727865:800306][12596:0x7f308b01ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:17:45.800+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:17:45.810+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3089f4a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3089F29000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F308AC01000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F308A9FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F308A703000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F308A4EE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F308A2D1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3089F29000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F308AE0A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3089f4a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:17:45.810+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:18:45.939+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] MongoDB starting : pid=12804 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:18:45.947+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:18:45.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:18:46.379+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727926:379103][12804:0x7fa152a0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:18:46.379+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:18:46.398+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa15193a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA151919000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1525F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1523ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1520F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA151EDE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA151CC1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA151919000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1527FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa15193a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:18:46.398+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:19:45.523+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] MongoDB starting : pid=13013 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:19:45.530+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:19:45.580+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:19:45.876+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507727985:876777][13013:0x7fbb03b45c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:19:45.876+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:19:45.887+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb02a75635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB02A54000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF646F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB0372C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB03528000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB0322E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB03019000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB02DFC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB02A54000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB03935000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb02a75635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:19:45.887+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:20:46.010+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] MongoDB starting : pid=13150 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:20:46.018+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:20:46.068+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:20:46.386+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728046:386627][13150:0x7fe840037c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:20:46.386+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:20:46.399+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe83ef67635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE83EF46000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE83FC1E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE83FA1A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE83F720000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE83F50B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE83F2EE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE83EF46000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE83FE27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe83ef67635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:20:46.399+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:21:45.856+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] MongoDB starting : pid=13445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:21:45.864+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:21:45.916+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:21:46.231+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728106:231734][13445:0x7fdd9f0fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:21:46.231+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:21:46.242+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd9e02a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD9E009000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3CCBD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD9ECE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD9EADD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD9E7E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD9E5CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD9E3B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD9E009000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD9EEEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd9e02a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:21:46.242+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:22:45.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] MongoDB starting : pid=13657 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:22:45.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:22:45.444+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:22:45.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728165:894939][13657:0x7f122fe10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:22:45.895+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:22:45.914+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f122ed40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F122ED1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF776FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F122F9F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F122F7F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F122F4F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F122F2E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F122F0C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F122ED1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F122FC00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f122ed40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:22:45.914+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:23:46.030+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] MongoDB starting : pid=13863 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:23:46.038+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:23:46.090+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:23:46.398+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728226:398060][13863:0x7f55cb350c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:23:46.398+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:23:46.422+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55ca280635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F55CA25F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F55CAF37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F55CAD33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F55CAA39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F55CA824000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F55CA607000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F55CA25F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F55CB140000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55ca280635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:23:46.422+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:24:45.557+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=14064 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:24:45.565+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:24:45.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:24:45.988+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728285:988248][14064:0x7fdae403dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:24:45.988+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:24:46.008+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdae2f6d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDAE2F4C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7704F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDAE3C24000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDAE3A20000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDAE3726000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDAE3511000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDAE32F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDAE2F4C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDAE3E2D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdae2f6d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:24:46.008+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:25:45.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=14205 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:25:45.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:25:45.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:25:45.518+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728345:518462][14205:0x7f11d1fb2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:25:45.518+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:25:45.529+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f11d0ee2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F11D0EC1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31045000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F11D1B99000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F11D1995000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F11D169B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F11D1486000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F11D1269000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F11D0EC1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F11D1DA2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f11d0ee2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:25:45.529+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:26:45.366+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=14784 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:26:45.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:26:45.424+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:26:45.762+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728405:762617][14784:0x7fe2a72ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:26:45.762+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:26:45.773+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2a620d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2A61EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2A6EC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2A6CC0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2A69C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2A67B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2A6594000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2A61EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2A70CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2a620d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:26:45.773+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:27:45.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] MongoDB starting : pid=15070 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:27:45.909+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:27:45.958+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:27:46.267+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728466:267740][15070:0x7f5285b12c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:27:46.267+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:27:46.278+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5284a42635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5284A21000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1708C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52856F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52854F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52851FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5284FE6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5284DC9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5284A21000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5285902000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5284a42635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:27:46.278+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:28:45.409+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] MongoDB starting : pid=15284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:28:45.416+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:28:45.417+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:28:45.467+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:28:45.807+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728525:807656][15284:0x7f76e7edec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:28:45.807+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:28:45.827+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f76e6e0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F76E6DED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2F6D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F76E7AC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F76E78C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F76E75C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F76E73B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F76E7195000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F76E6DED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F76E7CCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f76e6e0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:28:45.827+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:29:45.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] MongoDB starting : pid=15496 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:29:45.967+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:29:46.018+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:29:46.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728586:296043][15496:0x7f78a229ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:29:46.296+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:29:46.306+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78a11ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78A11A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78A1E81000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78A1C7D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78A1983000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78A176E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78A1551000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78A11A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78A208A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78a11ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:29:46.306+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:30:45.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] MongoDB starting : pid=15631 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:30:45.453+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:30:45.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:30:45.865+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728645:865124][15631:0x7f162c100c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:30:45.865+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:30:45.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f162b030635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F162B00F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA86FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F162BCE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F162BAE3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F162B7E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F162B5D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F162B3B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F162B00F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F162BEF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f162b030635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:30:45.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:31:45.424+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] MongoDB starting : pid=15917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:31:45.433+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:31:45.485+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:31:45.897+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728705:897838][15917:0x7f509a8efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:31:45.897+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:31:45.918+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f509981f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F50997FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF612FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F509A4D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F509A2D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5099FD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5099DC3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5099BA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F50997FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F509A6DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f509981f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:31:45.918+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:32:46.039+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:32:46.046+0000 I CONTROL [initandlisten] MongoDB starting : pid=16136 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:32:46.046+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:32:46.046+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:32:46.046+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:32:46.047+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:32:46.047+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:32:46.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:32:46.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:32:46.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:32:46.096+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:32:46.443+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728766:443596][16136:0x7f52fc412c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:32:46.443+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:32:46.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52fb342635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52FB321000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52FBFF9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52FBDF5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52FBAFB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52FB8E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52FB6C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52FB321000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52FC202000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52fb342635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:32:46.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:33:45.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=16347 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:33:45.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:33:45.628+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:33:45.924+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728825:924146][16347:0x7fce3d1cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:33:45.924+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:33:45.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce3c0fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE3C0DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4BAC2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE3CDB5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE3CBB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE3C8B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE3C6A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE3C485000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE3C0DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE3CFBE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce3c0fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:33:45.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:34:45.067+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=16537 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:34:45.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:34:45.075+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:34:45.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:34:45.510+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728885:510781][16537:0x7f67b36d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:34:45.510+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:34:45.521+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67b2606635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67B25E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66175000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67B32BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67B30B9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67B2DBF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67B2BAA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67B298D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67B25E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67B34C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67b2606635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:34:45.521+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:35:45.646+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=16681 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:35:45.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:35:45.706+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:35:46.012+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507728946:12086][16681:0x7fc294362c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:35:46.012+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:35:46.022+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc293292635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC293271000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2FF91000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC293F49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC293D45000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC293A4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC293836000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC293619000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC293271000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC294152000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc293292635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:35:46.022+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:36:45.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] MongoDB starting : pid=16827 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:36:45.642+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:36:45.691+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:36:45.955+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729005:955287][16827:0x7fc84982bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:36:45.955+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:36:45.965+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc84875b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC84873A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF224FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC849412000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC84920E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC848F14000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC848CFF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC848AE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC84873A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC84961B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc84875b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:36:45.965+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:37:45.077+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] MongoDB starting : pid=17085 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:37:45.085+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:37:45.136+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:37:45.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729065:416232][17085:0x7fa5a24e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:37:45.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:37:45.426+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5a1418635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5A13F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F22C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5A20CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5A1ECB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5A1BD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5A19BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5A179F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5A13F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5A22D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5a1418635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:37:45.426+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:38:45.559+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] MongoDB starting : pid=17294 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:38:45.568+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:38:45.620+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:38:45.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729125:915953][17294:0x7fea03576c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:38:45.916+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:38:45.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea024a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA02485000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15C08000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA0315D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA02F59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA02C5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA02A4A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA0282D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA02485000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA03366000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea024a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:38:45.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:39:45.071+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] MongoDB starting : pid=17494 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:39:45.078+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:39:45.128+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:39:45.436+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729185:436440][17494:0x7fa6547e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:39:45.436+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:39:45.456+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa653718635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6536F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08EA6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6543CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6541CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA653ED1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA653CBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA653A9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6536F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6545D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa653718635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:39:45.456+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:40:45.577+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] MongoDB starting : pid=17713 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:40:45.583+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:40:45.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:40:45.856+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729245:856078][17713:0x7f6aefcb7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:40:45.856+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:40:45.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6aeebe7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6AEEBC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6AEF89E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6AEF69A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6AEF3A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6AEF18B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6AEEF6E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6AEEBC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6AEFAA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6aeebe7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:40:45.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:41:45.771+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] MongoDB starting : pid=17873 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:41:45.778+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:41:45.779+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:41:45.779+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:41:45.829+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:41:46.202+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729306:202343][17873:0x7f1a74733c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:41:46.202+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:41:46.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a73663635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A73642000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB62FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A7431A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A74116000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A73E1C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A73C07000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A739EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A73642000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A74523000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a73663635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:41:46.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:42:45.332+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] MongoDB starting : pid=18137 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:42:45.341+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:42:45.393+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:42:45.759+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729365:759237][18137:0x7ffd674edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:42:45.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:42:45.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd6641f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD663FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFD67DFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD670D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD66ED2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD66BD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD669C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD667A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD663FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD672DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd6641f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:42:45.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:43:45.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=18355 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:43:45.910+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:43:45.961+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:43:46.279+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729426:279222][18355:0x7fba74d82c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:43:46.280+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:43:46.300+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba73cb2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA73C91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA74969000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA74765000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA7446B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA74256000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA74039000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA73C91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA74B72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba73cb2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:43:46.300+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:44:45.427+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] MongoDB starting : pid=18552 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:44:45.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:44:45.487+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:44:45.891+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729485:891506][18552:0x7f7eb2f82c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:44:45.891+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:44:45.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7eb1eb2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EB1E91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EB2B69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EB2965000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EB266B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EB2456000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EB2239000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EB1E91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EB2D72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7eb1eb2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:44:45.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:45:46.038+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] MongoDB starting : pid=18774 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:45:46.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:45:46.096+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:45:46.405+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729546:405240][18774:0x7f3c034c8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:45:46.405+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:45:46.415+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c023f8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C023D7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C030AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C02EAB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C02BB1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C0299C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C0277F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C023D7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C032B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c023f8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:45:46.415+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:46:45.155+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] MongoDB starting : pid=18923 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:46:45.163+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:46:45.214+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:46:45.539+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729605:539311][18923:0x7fb1310a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:46:45.539+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:46:45.549+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb12ffd5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB12FFB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB130C8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB130A88000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB13078E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB130579000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB13035C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB12FFB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB130E95000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb12ffd5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:46:45.550+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:47:45.674+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] MongoDB starting : pid=19200 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:47:45.682+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:47:45.732+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:47:46.026+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729666:26403][19200:0x7f32fad0dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:47:46.026+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:47:46.036+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32f9c3d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F32F9C1C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEE874000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F32FA8F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F32FA6F0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F32FA3F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F32FA1E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F32F9FC4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F32F9C1C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F32FAAFD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32f9c3d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:47:46.036+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:48:45.154+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] MongoDB starting : pid=19407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:48:45.162+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:48:45.163+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:48:45.213+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:48:45.575+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729725:575470][19407:0x7f441dc1ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:48:45.575+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:48:45.589+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f441cb4e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F441CB2D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F441D805000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F441D601000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F441D307000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F441D0F2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F441CED5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F441CB2D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F441DA0E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f441cb4e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:48:45.589+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:49:45.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] MongoDB starting : pid=19606 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:49:45.722+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:49:45.773+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:49:46.056+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729786:56496][19606:0x7fe59e7dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:49:46.056+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:49:46.067+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe59d70f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE59D6EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD3CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE59E3C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE59E1C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE59DEC8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE59DCB3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE59DA96000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE59D6EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE59E5CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe59d70f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:49:46.067+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:50:45.174+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] MongoDB starting : pid=19822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:50:45.182+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:50:45.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:50:45.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729845:533040][19822:0x7fefb2f1dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:50:45.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:50:45.544+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fefb1e4d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFB1E2C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF264FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFB2B04000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFB2900000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFB2606000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFB23F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFB21D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFB1E2C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFB2D0D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fefb1e4d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:50:45.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:51:45.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=19980 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:51:45.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:51:45.317+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:51:45.633+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729905:633957][19980:0x7ffcb66a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:51:45.634+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:51:45.653+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffcb55d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFCB55B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF768BA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFCB6290000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFCB608C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFCB5D92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFCB5B7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFCB5960000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFCB55B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFCB6499000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffcb55d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:51:45.653+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:52:45.785+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] MongoDB starting : pid=20254 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:52:45.792+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:52:45.841+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:52:46.190+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507729966:190777][20254:0x7f19085ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:52:46.190+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:52:46.210+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f190751b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19074FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF062FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19081D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1907FCE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1907CD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1907ABF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19078A2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19074FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19083DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f190751b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:52:46.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:53:45.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] MongoDB starting : pid=20463 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:53:45.350+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:53:45.400+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:53:45.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730025:784855][20463:0x7fe45c09ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:53:45.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:53:45.804+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe45afca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE45AFA9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF064FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE45BC81000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE45BA7D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE45B783000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE45B56E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE45B351000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE45AFA9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE45BE8A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe45afca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:53:45.804+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:54:45.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] MongoDB starting : pid=20668 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:54:45.942+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:54:45.991+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:54:46.294+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730086:294538][20668:0x7f7aa2c2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:54:46.294+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:54:46.305+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7aa1b5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7AA1B3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7AA2815000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7AA2611000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7AA2317000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7AA2102000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7AA1EE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7AA1B3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7AA2A1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7aa1b5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:54:46.305+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:55:45.438+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] MongoDB starting : pid=20877 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:55:45.447+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:55:45.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:55:45.813+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730145:813741][20877:0x7f631d8cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:55:45.813+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:55:45.824+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f631c7ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F631C7DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4641C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F631D4B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F631D2B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F631CFB8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F631CDA3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F631CB86000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F631C7DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F631D6BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f631c7ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:55:45.824+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:56:45.385+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] MongoDB starting : pid=21058 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:56:45.393+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:56:45.444+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:56:45.723+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730205:723868][21058:0x7f067149ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:56:45.723+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:56:45.743+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f06703ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F06703AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB30FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0671085000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0670E81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0670B87000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0670972000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0670755000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F06703AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F067128E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f06703ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:56:45.743+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:57:45.877+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] MongoDB starting : pid=21330 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:57:45.884+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:57:45.934+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:57:46.313+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730266:313072][21330:0x7f02d7e15c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:57:46.313+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:57:46.324+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f02d6d45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F02D6D24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE00FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F02D79FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F02D77F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F02D74FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02D72E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02D70CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F02D6D24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F02D7C05000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f02d6d45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:57:46.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:58:45.452+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=21547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:58:45.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:58:45.510+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:58:45.825+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730325:825414][21547:0x7f6ade25bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:58:45.825+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:58:45.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6add18b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6ADD16A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6ADDE42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6ADDC3E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6ADD944000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6ADD72F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6ADD512000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6ADD16A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6ADE04B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6add18b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:58:45.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T13:59:45.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] MongoDB starting : pid=21759 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] modules: none 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] build environment: 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T13:59:45.967+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T13:59:46.019+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T13:59:46.360+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730386:360830][21759:0x7f237c4c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T13:59:46.360+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T13:59:46.371+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f237b3f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F237B3D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F237C0B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F237BEAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F237BBB2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F237B99D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F237B780000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F237B3D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F237C2B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f237b3f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T13:59:46.371+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:00:45.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=21973 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:00:45.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:00:45.546+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:00:45.943+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730445:943545][21973:0x7f5fa60d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:00:45.943+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:00:45.963+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5fa5000635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5FA4FDF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF916FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5FA5CB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5FA5AB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5FA57B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5FA55A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5FA5387000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5FA4FDF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5FA5EC0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5fa5000635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:00:45.963+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:01:45.099+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] MongoDB starting : pid=22123 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:01:45.106+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:01:45.156+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:01:45.500+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730505:500604][22123:0x7f5e18112c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:01:45.500+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:01:45.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e17042635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E17021000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD142000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E17CF9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E17AF5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E177FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E175E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E173C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E17021000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E17F02000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e17042635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:01:45.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:02:45.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=22413 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:02:45.174+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:02:45.224+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:02:45.558+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730565:558853][22413:0x7fba033eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:02:45.558+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:02:45.569+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba0231a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA022F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF448F4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA02FD1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA02DCD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA02AD3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA028BE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA026A1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA022F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA031DA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba0231a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:02:45.569+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:03:45.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] MongoDB starting : pid=22622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:03:45.707+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:03:45.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:03:46.133+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730626:133115][22622:0x7f7d8ba91c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:03:46.133+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:03:46.143+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d8a9c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D8A9A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D8B678000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D8B474000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D8B17A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D8AF65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D8AD48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D8A9A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D8B881000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d8a9c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:03:46.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:04:45.270+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=22831 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:04:45.278+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:04:45.328+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:04:45.669+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730685:669672][22831:0x7fdb69942c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:04:45.669+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:04:45.682+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb68872635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB68851000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF801C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB69529000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB69325000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB6902B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB68E16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB68BF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB68851000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB69732000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb68872635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:04:45.682+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:05:45.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=23040 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:05:45.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:05:45.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:05:46.182+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730746:182010][23040:0x7fb29fd04c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:05:46.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:05:46.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb29ec34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB29EC13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF768FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB29F8EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB29F6E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB29F3ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB29F1D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB29EFBB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB29EC13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB29FAF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb29ec34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:05:46.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:06:45.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=23186 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:06:45.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:06:45.548+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:06:45.881+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730805:881973][23186:0x7f91765e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:06:45.882+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:06:45.892+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9175517635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91754F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F91761CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9175FCA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9175CD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9175ABB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F917589E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91754F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91763D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9175517635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:06:45.892+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:07:46.028+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] MongoDB starting : pid=23462 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:07:46.036+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:07:46.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:07:46.495+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730866:495952][23462:0x7fde2f649c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:07:46.496+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:07:46.515+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde2e579635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE2E558000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E991000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE2F230000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE2F02C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE2ED32000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE2EB1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE2E900000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE2E558000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE2F439000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde2e579635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:07:46.515+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:08:45.669+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] MongoDB starting : pid=23678 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:08:45.676+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:08:45.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:08:46.103+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730926:103066][23678:0x7f34333fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:08:46.103+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:08:46.122+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f343232e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F343230D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3432FE5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3432DE1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3432AE7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F34328D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F34326B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F343230D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34331EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f343232e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:08:46.122+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:09:45.239+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] MongoDB starting : pid=23875 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:09:45.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:09:45.296+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:09:45.580+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507730985:579988][23875:0x7f8716a91c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:09:45.580+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:09:45.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f87159c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87159A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99EB7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8716678000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8716474000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F871617A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8715F65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8715D48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87159A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8716881000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f87159c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:09:45.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:10:45.705+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] MongoDB starting : pid=24081 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:10:45.712+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:10:45.762+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:10:46.043+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731046:43881][24081:0x7f9fb80d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:10:46.043+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:10:46.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9fb7000635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9FB6FDF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD6FD9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9FB7CB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9FB7AB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9FB77B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9FB75A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9FB7387000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9FB6FDF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9FB7EC0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9fb7000635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:10:46.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:11:45.546+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] MongoDB starting : pid=24232 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:11:45.553+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:11:45.603+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:11:45.868+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731105:868431][24232:0x7f9240e95c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:11:45.868+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:11:45.878+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f923fdc5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F923FDA4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E03A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9240A7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9240878000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F924057E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9240369000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F924014C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F923FDA4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9240C85000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f923fdc5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:11:45.879+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:12:45.997+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] MongoDB starting : pid=24445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:12:46.004+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:12:46.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:12:46.394+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731166:394024][24445:0x7f65909f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:12:46.394+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:12:46.404+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f658f929635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F658F908000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA48FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65905E0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65903DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65900E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F658FECD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F658FCB0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F658F908000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65907E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f658f929635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:12:46.404+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:13:45.532+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] MongoDB starting : pid=24756 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:13:45.540+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:13:45.591+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:13:45.937+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731225:937612][24756:0x7f4c60850c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:13:45.937+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:13:45.958+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4c5f780635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4C5F75F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF906D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4C60437000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4C60233000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4C5FF39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4C5FD24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4C5FB07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4C5F75F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4C60640000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4c5f780635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:13:45.958+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:14:45.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] MongoDB starting : pid=24954 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:14:45.095+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:14:45.145+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:14:45.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731285:440647][24954:0x7f44d08ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:14:45.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:14:45.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44cf81c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44CF7FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E8FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44D04D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44D02CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44CFFD5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44CFDC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44CFBA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44CF7FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44D06DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44cf81c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:14:45.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:15:45.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=25157 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:15:45.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:15:45.641+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:15:46.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731346:62580][25157:0x7f2b3e8f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:15:46.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:15:46.082+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b3d822635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B3D801000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B1FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B3E4D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B3E2D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B3DFDB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B3DDC6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B3DBA9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B3D801000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B3E6E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b3d822635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:15:46.082+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:16:45.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] MongoDB starting : pid=25391 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:16:45.903+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:16:45.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:16:46.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731406:243615][25391:0x7f866bb4dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:16:46.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:16:46.254+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f866aa7d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F866AA5C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DA60000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F866B734000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F866B530000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F866B236000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F866B021000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F866AE04000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F866AA5C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F866B93D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f866aa7d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:16:46.254+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:17:45.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] MongoDB starting : pid=25554 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:17:45.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:17:45.438+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:17:45.726+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731465:726352][25554:0x7f1cba81bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:17:45.726+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:17:45.737+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1cb974b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CB972A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25BFA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CBA402000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CBA1FE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CB9F04000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CB9CEF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CB9AD2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CB972A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CBA60B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1cb974b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:17:45.737+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:18:45.870+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] MongoDB starting : pid=25813 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:18:45.878+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:18:45.928+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:18:46.302+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731526:302881][25813:0x7f3a7aec2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:18:46.302+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:18:46.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3a79df2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3A79DD1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3A7AAA9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3A7A8A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3A7A5AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3A7A396000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3A7A179000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3A79DD1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3A7ACB2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3a79df2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:18:46.322+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:19:45.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] MongoDB starting : pid=26012 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:19:45.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:19:45.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:19:45.843+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731585:843056][26012:0x7fd3dd33ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:19:45.843+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:19:45.853+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3dc26a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3DC249000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB52E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3DCF21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3DCD1D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3DCA23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3DC80E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD3DC5F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3DC249000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3DD12A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3dc26a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:19:45.853+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:20:45.974+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] MongoDB starting : pid=26212 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:20:45.982+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:20:46.032+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:20:46.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731646:377468][26212:0x7fe7ad643c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:20:46.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:20:46.396+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7ac573635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7AC552000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7AD22A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7AD026000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7ACD2C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7ACB17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7AC8FA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7AC552000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7AD433000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7ac573635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:20:46.396+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:21:45.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] MongoDB starting : pid=26443 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:21:45.967+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:21:46.018+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:21:46.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731706:377955][26443:0x7f380ae6fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:21:46.378+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:21:46.388+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3809d9f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3809D7E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9814000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F380AA56000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F380A852000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F380A558000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F380A343000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F380A126000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3809D7E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F380AC5F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3809d9f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:21:46.388+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:22:45.506+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] MongoDB starting : pid=26601 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:22:45.514+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:22:45.564+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:22:45.918+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731765:918162][26601:0x7ff0877abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:22:45.918+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:22:45.937+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff0866db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0866BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD69C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF087392000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF08718E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF086E94000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF086C7F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF086A62000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0866BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF08759B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff0866db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:22:45.937+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:23:45.066+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=26869 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:23:45.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:23:45.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:23:45.399+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731825:399973][26869:0x7f8d6acbdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:23:45.400+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:23:45.410+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d69bed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D69BCC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3690000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D6A8A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D6A6A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D6A3A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D6A191000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D69F74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D69BCC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D6AAAD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d69bed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:23:45.410+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:24:45.526+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=27075 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:24:45.534+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:24:45.584+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:24:45.855+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731885:855021][27075:0x7f002d06ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:24:45.855+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:24:45.865+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f002bf9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F002BF7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F002CC55000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F002CA51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F002C757000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F002C542000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F002C325000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F002BF7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F002CE5E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f002bf9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:24:45.865+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:25:45.983+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] MongoDB starting : pid=27292 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:25:45.991+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:25:46.040+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:25:46.339+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507731946:339098][27292:0x7f6340d17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:25:46.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:25:46.349+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f633fc47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F633FC26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2EE4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63408FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63406FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6340400000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63401EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F633FFCE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F633FC26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6340B07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f633fc47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:25:46.349+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:26:45.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=27520 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:26:45.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:26:45.233+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:26:45.543+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732005:543613][27520:0x7f45928d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:26:45.543+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:26:45.555+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4591802635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45917E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45924B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45922B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4591FBB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4591DA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4591B89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45917E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45926C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4591802635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:26:45.555+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:27:45.677+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] MongoDB starting : pid=27669 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:27:45.685+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:27:45.734+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:27:45.992+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732065:992823][27669:0x7ffb33dcbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:27:45.992+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:27:46.012+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb32cfb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB32CDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF356FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB339B2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB337AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB334B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB3329F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB33082000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB32CDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB33BBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb32cfb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:27:46.012+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:28:45.130+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=27944 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:28:45.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:28:45.189+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:28:45.594+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732125:594405][27944:0x7fde381cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:28:45.594+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:28:45.613+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde370ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE370DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76EBF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE37DB6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE37BB2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE378B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE376A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE37486000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE370DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE37FBF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde370ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:28:45.614+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:29:45.738+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] MongoDB starting : pid=28147 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:29:45.746+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:29:45.795+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:29:46.178+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732186:178764][28147:0x7f815fc8bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:29:46.178+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:29:46.198+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f815ebbb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F815EB9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79069000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F815F872000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F815F66E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F815F374000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F815F15F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F815EF42000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F815EB9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F815FA7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f815ebbb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:29:46.198+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:30:45.316+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] MongoDB starting : pid=28347 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:30:45.324+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:30:45.374+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:30:45.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732245:696716][28347:0x7f73791fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:30:45.696+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:30:45.716+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f737812b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F737810A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7192D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7378DE2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7378BDE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F73788E4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73786CF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73784B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F737810A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7378FEB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f737812b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:30:45.716+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:31:45.122+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] MongoDB starting : pid=28572 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:31:45.130+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:31:45.182+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:31:45.476+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732305:476948][28572:0x7fbd4f603c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:31:45.477+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:31:45.487+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbd4e533635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBD4E512000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F2BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBD4F1EA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBD4EFE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBD4ECEC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBD4EAD7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBD4E8BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBD4E512000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBD4F3F3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbd4e533635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:31:45.487+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:32:45.504+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] MongoDB starting : pid=28720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:32:45.511+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:32:45.562+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:32:45.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732365:933113][28720:0x7f3d7ff67c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:32:45.933+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:32:45.952+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d7ee97635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D7EE76000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF294FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D7FB4E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D7F94A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D7F650000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D7F43B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D7F21E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D7EE76000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D7FD57000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d7ee97635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:32:45.952+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:33:45.086+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=29000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:33:45.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:33:45.146+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:33:45.477+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732425:477753][29000:0x7f5253fd4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:33:45.477+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:33:45.489+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5252f04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5252EE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5628B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5253BBB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52539B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52536BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52534A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F525328B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5252EE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5253DC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5252f04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:33:45.489+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:34:45.629+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=29209 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:34:45.639+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:34:45.691+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:34:46.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732486:50578][29209:0x7f8b9473cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:34:46.050+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:34:46.061+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b9366c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B9364B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B94323000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B9411F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B93E25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B93C10000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B939F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B9364B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B9452C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b9366c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:34:46.061+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:35:45.187+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] MongoDB starting : pid=29407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:35:45.195+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:35:45.245+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:35:45.524+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732545:524463][29407:0x7fa9b9cdbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:35:45.524+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:35:45.544+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9b8c0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9B8BEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9B98C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9B96BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9B93C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9B91AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9B8F92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9B8BEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9B9ACB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9b8c0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:35:45.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:36:45.971+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=29632 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:36:45.979+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:36:46.031+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:36:46.414+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732606:414311][29632:0x7f71afa6cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:36:46.414+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:36:46.434+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f71ae99c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F71AE97B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F71AF653000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71AF44F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71AF155000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71AEF40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71AED23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F71AE97B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F71AF85C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f71ae99c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:36:46.434+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:37:45.128+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] MongoDB starting : pid=29785 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:37:45.136+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:37:45.187+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:37:45.570+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732665:570456][29785:0x7f2d53322c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:37:45.570+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:37:45.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d52252635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D52231000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00CD2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D52F09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D52D05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D52A0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D527F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D525D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D52231000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D53112000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d52252635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:37:45.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:38:45.718+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] MongoDB starting : pid=30066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:38:45.725+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:38:45.726+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:38:45.776+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:38:46.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732726:153358][30066:0x7f4e48a9bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:38:46.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:38:46.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e479cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E479AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4380E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E48682000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E4847E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E48184000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E47F6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E47D52000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E479AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E4888B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e479cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:38:46.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:39:45.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] MongoDB starting : pid=30264 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:39:45.307+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:39:45.358+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:39:45.745+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732785:745556][30264:0x7f7dd8aa6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:39:45.745+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:39:45.756+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dd79d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DD79B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DD868D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DD8489000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DD818F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DD7F7A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DD7D5D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DD79B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DD8896000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dd79d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:39:45.756+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:40:45.879+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=30476 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:40:45.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:40:45.936+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:40:46.278+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732846:278859][30476:0x7f41a7cf1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:40:46.278+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:40:46.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41a6c21635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41A6C00000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7C5C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F41A78D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F41A76D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41A73DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F41A71C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F41A6FA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41A6C00000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41A7AE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41a6c21635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:40:46.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:41:45.741+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:41:45.748+0000 I CONTROL [initandlisten] MongoDB starting : pid=30712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:41:45.748+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:41:45.748+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:41:45.749+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:41:45.749+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:41:45.749+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:41:45.749+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:41:45.749+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:41:45.749+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:41:45.800+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:41:46.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732906:161712][30712:0x7f10f5c85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:41:46.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:41:46.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f10f4bb5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F10F4B94000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF07CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10F586C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10F5668000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10F536E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10F5159000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10F4F3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F10F4B94000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F10F5A75000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f10f4bb5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:41:46.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:42:45.502+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] MongoDB starting : pid=30872 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:42:45.510+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:42:45.560+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:42:45.862+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507732965:862096][30872:0x7fc550b6ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:42:45.862+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:42:45.873+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc54fa9a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC54FA79000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC550751000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC55054D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC550253000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC55003E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC54FE21000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC54FA79000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC55095A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc54fa9a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:42:45.873+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:43:45.986+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=31152 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:43:45.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:43:46.047+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:43:46.376+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733026:376408][31152:0x7fdc90923c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:43:46.376+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:43:46.395+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc8f853635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC8F832000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC84FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC9050A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC90306000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC9000C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC8FDF7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC8FBDA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC8F832000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC90713000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc8f853635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:43:46.395+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:44:45.519+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] MongoDB starting : pid=31354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:44:45.526+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:44:45.577+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:44:45.936+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733085:936614][31354:0x7f7c986edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:44:45.936+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:44:45.956+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c9761d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C975FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF11215000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C982D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C980D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C97DD6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C97BC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C979A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C975FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C984DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c9761d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:44:45.956+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:45:45.076+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] MongoDB starting : pid=31553 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:45:45.087+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:45:45.153+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:45:45.452+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733145:452913][31553:0x7f1364fd7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:45:45.453+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:45:45.472+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1363f07635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1363EE6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6E829000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1364BBE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F13649BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F13646C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F13644AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F136428E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1363EE6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1364DC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1363f07635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:45:45.473+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:46:45.878+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=31772 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:46:45.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:46:45.935+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:46:46.225+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733206:225913][31772:0x7f9a0536ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:46:46.225+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:46:46.236+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a0429e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A0427D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0682000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A04F55000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A04D51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A04A57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A04842000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A04625000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A0427D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A0515E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a0429e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:46:46.236+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:47:46.008+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] MongoDB starting : pid=31920 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:47:46.016+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:47:46.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:47:46.418+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733266:418821][31920:0x7f0561e05c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:47:46.418+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:47:46.429+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0560d35635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0560D14000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91392000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F05619EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F05617E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F05614EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F05612D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F05610BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0560D14000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0561BF5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0560d35635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:47:46.429+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:48:45.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:48:45.550+0000 I CONTROL [initandlisten] MongoDB starting : pid=32054 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:48:45.551+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:48:45.602+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:48:45.954+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733325:954930][32054:0x7f094d0a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:48:45.954+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:48:45.966+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f094bfd2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F094BFB1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F094CC89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F094CA85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F094C78B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F094C576000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F094C359000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F094BFB1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F094CE92000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f094bfd2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:48:45.966+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:49:45.116+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] MongoDB starting : pid=32304 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:49:45.124+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:49:45.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:49:45.523+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733385:523572][32304:0x7f3b86e5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:49:45.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:49:45.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b85d8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B85D6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51E6A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3B86A44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3B86840000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3B86546000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3B86331000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B86114000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B85D6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3B86C4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b85d8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:49:45.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:50:45.666+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=32507 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:50:45.674+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:50:45.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:50:45.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733445:994232][32507:0x7fc318dedc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:50:45.994+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:50:46.004+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc317d1d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC317CFC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF37A88000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3189D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3187D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3184D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3182C1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3180A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC317CFC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC318BDD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc317d1d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:50:46.004+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:51:45.484+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:51:45.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=32739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:51:45.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:51:45.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:51:45.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:51:45.491+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:51:45.491+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:51:45.492+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:51:45.492+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:51:45.492+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:51:45.542+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:51:45.826+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733505:826056][32739:0x7f561c85dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:51:45.826+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:51:45.836+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f561b78d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F561B76C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBCAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F561C444000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F561C240000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F561BF46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F561BD31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F561BB14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F561B76C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F561C64D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f561b78d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:51:45.836+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:52:45.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=501 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:52:45.274+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:52:45.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:52:45.614+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733565:614237][501:0x7fa5ab225c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:52:45.614+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:52:45.624+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5aa155635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5AA134000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3826000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5AAE0C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5AAC08000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5AA90E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5AA6F9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5AA4DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5AA134000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5AB015000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5aa155635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:52:45.624+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:53:45.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:53:45.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=639 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:53:45.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:53:45.808+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:53:46.113+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733626:113037][639:0x7f7f6f3e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:53:46.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:53:46.123+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f6e317635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F6E2F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF754FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F6EFCE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F6EDCA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F6EAD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F6E8BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F6E69E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F6E2F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F6F1D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f6e317635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:53:46.123+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:54:45.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] MongoDB starting : pid=890 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:54:45.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:54:45.295+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:54:45.554+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733685:554595][890:0x7f15a5cb3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:54:45.554+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:54:45.565+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15a4be3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15A4BC2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49DBB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15A589A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15A5696000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15A539C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15A5187000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15A4F6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15A4BC2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15A5AA3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15a4be3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:54:45.565+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:55:45.694+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] MongoDB starting : pid=1092 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:55:45.702+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:55:45.752+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:55:46.028+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733746:28943][1092:0x7f4882103c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:55:46.029+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:55:46.039+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4881033635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4881012000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4881CEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4881AE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F48817EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F48815D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F48813BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4881012000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4881EF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4881033635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:55:46.039+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:56:45.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] MongoDB starting : pid=1316 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:56:45.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:56:45.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:56:45.833+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733805:833482][1316:0x7f0fa32fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:56:45.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:56:45.855+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fa222a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FA2209000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF809C7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FA2EE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FA2CDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FA29E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FA27CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FA25B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FA2209000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FA30EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fa222a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:56:45.855+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:57:45.552+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] MongoDB starting : pid=1555 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:57:45.560+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:57:45.610+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:57:45.899+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733865:899959][1555:0x7f80bf4fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:57:45.900+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:57:45.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80be42b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80BE40A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF23697000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80BF0E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80BEEDE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80BEBE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80BE9CF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80BE7B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80BE40A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80BF2EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80be42b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:57:45.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:58:46.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=1699 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:58:46.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:58:46.088+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:58:46.420+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733926:420809][1699:0x7fec160adc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:58:46.420+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:58:46.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec14fdd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC14FBC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE814D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC15C94000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC15A90000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC15796000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC15581000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC15364000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC14FBC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC15E9D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec14fdd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:58:46.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T14:59:45.553+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] MongoDB starting : pid=1951 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] modules: none 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] build environment: 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T14:59:45.561+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T14:59:45.614+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T14:59:45.904+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507733985:904717][1951:0x7f04cd3adc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T14:59:45.904+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T14:59:45.915+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04cc2dd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04CC2BC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9ACEE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04CCF94000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04CCD90000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04CCA96000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04CC881000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04CC664000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04CC2BC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04CD19D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04cc2dd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T14:59:45.915+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:00:46.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=2160 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:00:46.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:00:46.105+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:00:46.393+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734046:393515][2160:0x7f76ad7c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:00:46.393+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:00:46.404+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f76ac6f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F76AC6D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F76AD3A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F76AD1A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F76ACEAA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F76ACC95000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F76ACA78000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F76AC6D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F76AD5B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f76ac6f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:00:46.404+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:01:45.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=2387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:01:45.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:01:45.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:01:46.146+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734106:146156][2387:0x7f0b24c9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:01:46.146+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:01:46.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0b23bcc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0B23BAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80673000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0B24883000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0B2467F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0B24385000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0B24170000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0B23F53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0B23BAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0B24A8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0b23bcc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:01:46.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:02:45.659+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] MongoDB starting : pid=2628 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:02:45.667+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:02:45.720+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:02:46.007+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734166:7977][2628:0x7f94b380ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:02:46.008+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:02:46.027+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94b273a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F94B2719000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F94B33F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F94B31ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F94B2EF3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F94B2CDE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F94B2AC1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F94B2719000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94B35FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94b273a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:02:46.027+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:03:45.152+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] MongoDB starting : pid=2761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:03:45.160+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:03:45.210+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:03:45.487+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734225:487781][2761:0x7fc9cf05cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:03:45.487+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:03:45.499+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9cdf8c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9CDF6B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF078FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9CEC43000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9CEA3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9CE745000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9CE530000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9CE313000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9CDF6B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9CEE4C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9cdf8c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:03:45.499+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:04:45.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=3028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:04:45.622+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:04:45.673+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:04:46.036+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734286:36005][3028:0x7f8ea12ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:04:46.036+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:04:46.046+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ea01fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EA01DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EA0EB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EA0CAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EA09B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EA07A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EA0583000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EA01DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EA10BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ea01fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:04:46.046+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:05:45.168+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] MongoDB starting : pid=3232 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:05:45.176+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:05:45.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:05:45.521+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734345:521983][3232:0x7f0e4a1dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:05:45.522+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:05:45.532+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e4910f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E490EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCBEE2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E49DC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E49BC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E498C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E496B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E49496000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E490EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E49FCF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e4910f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:05:45.532+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:06:45.925+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] MongoDB starting : pid=3465 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:06:45.933+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:06:45.983+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:06:46.275+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734406:275985][3465:0x7ff4dcc61c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:06:46.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:06:46.287+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff4dbb91635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF4DBB70000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF4DC848000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF4DC644000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF4DC34A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF4DC135000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF4DBF18000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF4DBB70000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF4DCA51000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff4dbb91635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:06:46.287+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:07:45.873+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=3701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:07:45.882+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:07:45.933+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:07:46.190+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734466:190556][3701:0x7f61c2b47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:07:46.190+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:07:46.201+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61c1a77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61C1A56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98801000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61C272E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61C252A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61C2230000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61C201B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61C1DFE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61C1A56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61C2937000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61c1a77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:07:46.201+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:08:45.314+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=3837 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:08:45.322+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:08:45.374+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:08:45.758+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734525:758934][3837:0x7f61609e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:08:45.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:08:45.778+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f615f912635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F615F8F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF06DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61605C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61603C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61600CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F615FEB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F615FC99000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F615F8F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61607D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f615f912635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:08:45.778+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:09:45.905+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=4099 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:09:45.913+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:09:45.963+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:09:46.356+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734586:356848][4099:0x7f2b977d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:09:46.356+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:09:46.377+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b96702635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B966E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79ADF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B973B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B971B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B96EBB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B96CA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B96A89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B966E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B975C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b96702635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:09:46.377+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:10:45.500+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] MongoDB starting : pid=4301 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:10:45.508+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:10:45.559+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:10:45.938+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734645:938349][4301:0x7f508b75ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:10:45.938+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:10:45.949+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f508a68a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F508A669000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62686000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F508B341000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F508B13D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F508AE43000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F508AC2E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F508AA11000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F508A669000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F508B54A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f508a68a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:10:45.949+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:11:45.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=4534 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:11:45.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:11:45.396+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:11:45.779+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734705:779666][4534:0x7feb2f3fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:11:45.779+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:11:45.800+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb2e32c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB2E30B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0A1D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB2EFE3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB2EDDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB2EAE5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB2E8D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB2E6B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB2E30B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB2F1EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb2e32c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:11:45.800+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:12:45.996+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] MongoDB starting : pid=4772 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:12:46.005+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:12:46.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:12:46.412+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734766:412905][4772:0x7f403be19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:12:46.412+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:12:46.423+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f403ad49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F403AD28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF518FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F403BA00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F403B7FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F403B502000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F403B2ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F403B0D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F403AD28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F403BC09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f403ad49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:12:46.423+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:13:45.559+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] MongoDB starting : pid=4925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:13:45.567+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:13:45.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:13:45.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734825:910687][4925:0x7f05b4f0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:13:45.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:13:45.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f05b3e3a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F05B3E19000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDE3A6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F05B4AF1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F05B48ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F05B45F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F05B43DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F05B41C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F05B3E19000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F05B4CFA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f05b3e3a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:13:45.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:14:46.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=5405 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:14:46.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:14:46.106+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:14:46.486+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734886:486041][5405:0x7ff1c5a2fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:14:46.486+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:14:46.506+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1c495f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1C493E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5CF2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF1C5616000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF1C5412000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF1C5118000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1C4F03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1C4CE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1C493E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1C581F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1c495f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:14:46.506+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:15:45.633+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] MongoDB starting : pid=5720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:15:45.640+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:15:45.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:15:45.949+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507734945:949734][5720:0x7f1c7ed0bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:15:45.949+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:15:45.969+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c7dc3b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C7DC1A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA32C0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C7E8F2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C7E6EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C7E3F4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C7E1DF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C7DFC2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C7DC1A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C7EAFB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c7dc3b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:15:45.969+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:16:45.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=6128 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:16:45.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:16:45.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:16:45.777+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735005:777319][6128:0x7f225a114c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:16:45.777+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:16:45.787+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2259044635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2259023000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF72FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2259CFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2259AF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22597FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22595E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22593CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2259023000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2259F04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2259044635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:16:45.787+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:17:45.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] MongoDB starting : pid=6499 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:17:45.095+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:17:45.148+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:17:45.562+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735065:562259][6499:0x7f9adcb4bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:17:45.562+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:17:45.583+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9adba7b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9ADBA5A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9ADC732000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9ADC52E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9ADC234000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9ADC01F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9ADBE02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9ADBA5A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9ADC93B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9adba7b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:17:45.584+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:18:45.703+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] MongoDB starting : pid=6640 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:18:45.711+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:18:45.763+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:18:46.047+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735126:47839][6640:0x7fd5c5d35c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:18:46.047+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:18:46.058+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5c4c65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5C4C44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEB094000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD5C591C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5C5718000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5C541E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5C5209000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5C4FEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5C4C44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5C5B25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5c4c65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:18:46.058+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:19:45.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=6913 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:19:45.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:19:45.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:19:45.534+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735185:534865][6913:0x7fa5584edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:19:45.534+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:19:45.545+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa55741d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5573FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC28AD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5580D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA557ED0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA557BD6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5579C1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5577A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5573FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5582DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa55741d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:19:45.545+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:20:45.683+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] MongoDB starting : pid=7122 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:20:45.691+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:20:45.742+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:20:46.039+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735246:39357][7122:0x7f7a6a806c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:20:46.039+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:20:46.049+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a69736635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A69715000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF138E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A6A3ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A6A1E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A69EEF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A69CDA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A69ABD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A69715000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A6A5F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a69736635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:20:46.049+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:21:45.456+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] MongoDB starting : pid=7346 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:21:45.464+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:21:45.514+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:21:45.809+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735305:809840][7346:0x7f1a08004c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:21:45.809+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:21:45.820+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a06f34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A06F13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF222FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A07BEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A079E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A076ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A074D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A072BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A06F13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A07DF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a06f34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:21:45.820+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:22:45.526+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=7531 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:22:45.534+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:22:45.585+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:22:45.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735365:846384][7531:0x7f43eaf36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:22:45.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:22:45.856+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f43e9e66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F43E9E45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F43EAB1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F43EA919000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F43EA61F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43EA40A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F43EA1ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F43E9E45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F43EAD26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f43e9e66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:22:45.856+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:23:45.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=7711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:23:45.998+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:23:46.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:23:46.329+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735426:329301][7711:0x7f98119d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:23:46.329+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:23:46.339+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9810902635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98108E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4140B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98115B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98113B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98110BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9810EA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9810C89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98108E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98117C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9810902635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:23:46.339+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:24:45.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] MongoDB starting : pid=7828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:24:45.471+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:24:45.522+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:24:45.858+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735485:858911][7828:0x7f98bd178c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:24:45.858+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:24:45.869+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98bc0a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98BC087000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF940FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98BCD5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98BCB5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98BC861000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98BC64C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98BC42F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98BC087000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98BCF68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98bc0a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:24:45.869+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:25:45.986+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] MongoDB starting : pid=8078 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:25:45.994+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:25:46.046+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:25:46.323+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735546:323304][8078:0x7f8b39a78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:25:46.323+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:25:46.333+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b389a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B38987000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0CD7A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B3965F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B3945B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B39161000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B38F4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B38D2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B38987000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B39868000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b389a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:25:46.333+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:26:45.779+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=8310 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:26:45.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:26:45.837+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:26:46.097+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735606:97408][8310:0x7f20b1fc5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:26:46.097+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:26:46.107+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f20b0ef5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F20B0ED4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF605F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F20B1BAC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F20B19A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20B16AE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F20B1499000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F20B127C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F20B0ED4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F20B1DB5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f20b0ef5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:26:46.107+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:27:45.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] MongoDB starting : pid=8564 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:27:45.874+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:27:45.924+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:27:46.207+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735666:207450][8564:0x7f662dfd5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:27:46.207+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:27:46.218+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f662cf05635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F662CEE4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCEC62000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F662DBBC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F662D9B8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F662D6BE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F662D4A9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F662D28C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F662CEE4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F662DDC5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f662cf05635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:27:46.218+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:28:45.341+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] MongoDB starting : pid=8800 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:28:45.349+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:28:45.398+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:28:45.731+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735725:731602][8800:0x7f105fe3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:28:45.731+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:28:45.742+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f105ed6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F105ED4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F105FA25000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F105F821000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F105F527000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F105F312000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F105F0F5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F105ED4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F105FC2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f105ed6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:28:45.742+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:29:45.879+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] MongoDB starting : pid=8912 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:29:45.887+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:29:45.939+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:29:46.286+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735786:286731][8912:0x7f906ef38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:29:46.286+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:29:46.306+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f906de68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F906DE47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F906EB1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F906E91B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F906E621000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F906E40C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F906E1EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F906DE47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F906ED28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f906de68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:29:46.306+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:30:45.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] MongoDB starting : pid=9179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:30:45.437+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:30:45.472+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:30:45.716+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735845:716515][9179:0x7ffcc2becc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:30:45.716+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:30:45.736+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffcc1b1c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFCC1AFB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A43B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFCC27D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFCC25CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFCC22D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFCC20C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFCC1EA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFCC1AFB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFCC29DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffcc1b1c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:30:45.736+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:31:45.123+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] MongoDB starting : pid=9403 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:31:45.130+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:31:45.180+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:31:45.464+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735905:464169][9403:0x7fa454a30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:31:45.464+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:31:45.488+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa453960635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA45393F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC49F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA454617000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA454413000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA454119000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA453F04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA453CE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA45393F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA454820000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa453960635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:31:45.488+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:32:45.937+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] MongoDB starting : pid=9633 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:32:45.945+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:32:45.995+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:32:46.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507735966:306854][9633:0x7f8d6f55cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:32:46.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:32:46.317+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d6e48c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D6E46B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14262000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D6F143000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D6EF3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D6EC45000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D6EA30000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D6E813000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D6E46B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D6F34C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d6e48c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:32:46.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:33:45.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=9859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:33:45.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:33:45.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:33:45.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736025:837760][9859:0x7fc0ff722c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:33:45.837+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:33:45.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc0fe652635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC0FE631000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF516FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC0FF309000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC0FF105000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC0FEE0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC0FEBF6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC0FE9D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC0FE631000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC0FF512000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc0fe652635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:33:45.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:34:45.997+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:34:46.004+0000 I CONTROL [initandlisten] MongoDB starting : pid=9976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:34:46.005+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:34:46.055+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:34:46.365+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736086:365127][9976:0x7f1319cdac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:34:46.365+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:34:46.384+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1318c0a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1318BE9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCBCC8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F13198C1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F13196BD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F13193C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F13191AE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1318F91000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1318BE9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1319ACA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1318c0a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:34:46.384+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:35:45.504+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] MongoDB starting : pid=10239 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:35:45.512+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:35:45.561+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:35:45.854+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736145:854130][10239:0x7f8d50eaac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:35:45.854+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:35:45.867+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d4fdda635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D4FDB9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D50A91000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D5088D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D50593000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D5037E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D50161000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D4FDB9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D50C9A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d4fdda635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:35:45.867+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:36:45.246+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] MongoDB starting : pid=10466 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:36:45.254+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:36:45.304+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:36:45.586+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736205:586139][10466:0x7faf6f586c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:36:45.586+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:36:45.596+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf6e4b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF6E495000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF22089000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF6F16D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF6EF69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF6EC6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF6EA5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF6E83D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF6E495000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF6F376000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf6e4b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:36:45.596+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:37:45.467+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] MongoDB starting : pid=10696 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:37:45.475+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:37:45.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:37:45.825+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736265:825363][10696:0x7f1cd8dc0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:37:45.825+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:37:45.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1cd7cf0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CD7CCF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CD89A7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CD87A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CD84A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CD8294000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CD8077000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CD7CCF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CD8BB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1cd7cf0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:37:45.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:38:45.954+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] MongoDB starting : pid=10928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:38:45.964+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:38:46.014+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:38:46.332+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736326:332307][10928:0x7f7d46f03c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:38:46.332+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:38:46.343+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d45e33635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D45E12000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D46AEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D468E6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D465EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D463D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D461BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D45E12000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D46CF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d45e33635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:38:46.343+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:39:45.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] MongoDB starting : pid=11043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:39:45.476+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:39:45.526+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:39:45.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736385:911401][11043:0x7fdf62f34c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:39:45.911+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:39:45.930+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf61e64635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF61E43000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF62B1B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF62917000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF6261D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF62408000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF621EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF61E43000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF62D24000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf61e64635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:39:45.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:40:45.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] MongoDB starting : pid=11296 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:40:45.063+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:40:45.113+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:40:45.371+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736445:371561][11296:0x7fb04c787c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:40:45.371+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:40:45.384+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb04b6b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB04B696000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF83CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB04C36E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB04C16A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB04BE70000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB04BC5B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB04BA3E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB04B696000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB04C577000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb04b6b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:40:45.384+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:41:45.871+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] MongoDB starting : pid=11531 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:41:45.880+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:41:45.929+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:41:46.262+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736506:262678][11531:0x7f5b3fc07c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:41:46.262+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:41:46.273+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5b3eb37635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5B3EB16000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5B3F7EE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5B3F5EA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5B3F2F0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5B3F0DB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5B3EEBE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5B3EB16000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5B3F9F7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5b3eb37635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:41:46.273+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:42:45.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=11774 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:42:45.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:42:45.639+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:42:46.015+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736566:15110][11774:0x7f89c33fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:42:46.015+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:42:46.025+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f89c232a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F89C2309000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF0FFD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F89C2FE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F89C2DDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F89C2AE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F89C28CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F89C26B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F89C2309000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F89C31EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f89c232a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:42:46.025+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:43:45.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=11999 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:43:45.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:43:45.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:43:45.479+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736625:479579][11999:0x7f3e2c27ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:43:45.479+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:43:45.490+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e2b1ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E2B18D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE44FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E2BE65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E2BC61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E2B967000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E2B752000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E2B535000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E2B18D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E2C06E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e2b1ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:43:45.490+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:44:45.615+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:44:45.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=12122 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:44:45.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:44:45.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:44:46.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736686:19980][12122:0x7f78adf7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:44:46.020+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:44:46.040+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78aceab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78ACE8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1EF0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78ADB62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78AD95E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78AD664000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78AD44F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78AD232000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78ACE8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78ADD6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78aceab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:44:46.040+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:45:45.172+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] MongoDB starting : pid=12516 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:45:45.180+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:45:45.231+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:45:45.528+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736745:528933][12516:0x7f8c628dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:45:45.529+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:45:45.548+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8c6180b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8C617EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF480FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8C624C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8C622BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8C61FC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8C61DAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8C61B92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8C617EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8C626CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8c6180b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:45:45.548+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:46:45.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] MongoDB starting : pid=12830 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:46:45.967+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:46:46.017+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:46:46.335+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736806:335210][12830:0x7f44c5008c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:46:46.335+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:46:46.346+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44c3f38635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44C3F17000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44C4BEF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44C49EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44C46F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44C44DC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44C42BF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44C3F17000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44C4DF8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44c3f38635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:46:46.346+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:47:45.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] MongoDB starting : pid=13060 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:47:45.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:47:45.746+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:47:46.063+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736866:63486][13060:0x7f3fc1622c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:47:46.063+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:47:46.083+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3fc0552635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3FC0531000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF450FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3FC1209000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3FC1005000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3FC0D0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3FC0AF6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3FC08D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3FC0531000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3FC1412000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3fc0552635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:47:46.083+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:48:45.214+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] MongoDB starting : pid=13285 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:48:45.222+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:48:45.272+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:48:45.573+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736925:573812][13285:0x7f5626295c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:48:45.573+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:48:45.584+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56251c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56251A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5625E7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5625C78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F562597E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5625769000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F562554C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56251A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5626085000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56251c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:48:45.584+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:49:45.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] MongoDB starting : pid=13402 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:49:45.722+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:49:45.772+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:49:46.081+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507736986:81948][13402:0x7f33aeff9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:49:46.082+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:49:46.092+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33adf29635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33ADF08000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33AEBE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33AE9DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33AE6E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33AE4CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33AE2B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33ADF08000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33AEDE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33adf29635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:49:46.093+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:50:45.215+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:50:45.223+0000 I CONTROL [initandlisten] MongoDB starting : pid=13656 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:50:45.224+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:50:45.276+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:50:45.638+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737045:638638][13656:0x7f40eb288c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:50:45.638+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:50:45.658+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40ea1b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40EA197000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40EAE6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40EAC6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40EA971000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40EA75C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40EA53F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40EA197000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40EB078000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40ea1b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:50:45.658+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:51:45.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=13881 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:51:45.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:51:45.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:51:45.433+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737105:433543][13881:0x7f0acecd3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:51:45.433+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:51:45.445+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0acdc03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0ACDBE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA68FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0ACE8BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0ACE6B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0ACE3BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0ACE1A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0ACDF8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0ACDBE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0ACEAC3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0acdc03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:51:45.445+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:52:45.989+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] MongoDB starting : pid=14116 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:52:45.996+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:52:46.046+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:52:46.365+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737166:365100][14116:0x7f0f4b728c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:52:46.365+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:52:46.375+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0f4a658635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0F4A637000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF978FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0F4B30F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0F4B10B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0F4AE11000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0F4ABFC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0F4A9DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0F4A637000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0F4B518000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0f4a658635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:52:46.375+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:53:45.505+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] MongoDB starting : pid=14337 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:53:45.513+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:53:45.566+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:53:45.936+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737225:936117][14337:0x7fc7a1586c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:53:45.936+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:53:45.955+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7a04b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7A0495000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA43F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7A116D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7A0F69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7A0C6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7A0A5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7A083D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7A0495000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7A1376000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7a04b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:53:45.955+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:54:45.111+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] MongoDB starting : pid=14748 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:54:45.119+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:54:45.170+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:54:45.506+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737285:506871][14748:0x7f70daba7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:54:45.506+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:54:45.517+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f70d9ad7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F70D9AB6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE060000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F70DA78E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F70DA58A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F70DA290000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F70DA07B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F70D9E5E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F70D9AB6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F70DA997000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f70d9ad7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:54:45.517+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:55:45.631+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=15103 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:55:45.639+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:55:45.692+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:55:46.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737346:62696][15103:0x7f2af2fa5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:55:46.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:55:46.083+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2af1ed5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2AF1EB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E683000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2AF2B8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2AF2988000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2AF268E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2AF2479000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2AF225C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2AF1EB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2AF2D95000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2af1ed5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:55:46.083+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:56:45.484+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] MongoDB starting : pid=15332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:56:45.492+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:56:45.543+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:56:45.829+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737405:829312][15332:0x7fcd2aaddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:56:45.829+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:56:45.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd29a0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD299EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD2A6C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD2A4C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD2A1C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD29FB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD29D94000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD299EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD2A8CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd29a0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:56:45.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:57:45.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:57:45.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=15577 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:57:45.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:57:45.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:57:45.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:57:45.174+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:57:45.175+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:57:45.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:57:45.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:57:45.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:57:45.225+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:57:45.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737465:561197][15577:0x7f6fc8962c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:57:45.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:57:45.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6fc7892635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6FC7871000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC46B1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6FC8549000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6FC8345000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6FC804B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6FC7E36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6FC7C19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6FC7871000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6FC8752000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6fc7892635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:57:45.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:58:45.713+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=15773 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:58:45.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:58:45.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:58:46.089+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737526:89607][15773:0x7f5c3f356c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:58:46.089+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:58:46.100+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c3e286635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C3E265000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5623000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C3EF3D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C3ED39000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C3EA3F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C3E82A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C3E60D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C3E265000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C3F146000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c3e286635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:58:46.100+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T15:59:45.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=15938 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] modules: none 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] build environment: 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T15:59:45.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T15:59:45.289+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T15:59:45.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737585:662775][15938:0x7f81891aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T15:59:45.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T15:59:45.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f81880de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F81880BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8763E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8188D95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8188B91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8188897000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8188682000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8188465000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F81880BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8188F9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f81880de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T15:59:45.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:00:45.823+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=16055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:00:45.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:00:45.880+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:00:46.234+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737646:234232][16055:0x7f6eb29a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:00:46.234+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:00:46.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6eb18d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6EB18B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CA64000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6EB2589000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6EB2385000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6EB208B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6EB1E76000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6EB1C59000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6EB18B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6EB2792000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6eb18d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:00:46.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:01:45.646+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=16335 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:01:45.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:01:45.704+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:01:45.997+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737705:997282][16335:0x7f61e38e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:01:45.997+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:01:46.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61e2814635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61E27F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91C4F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61E34CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61E32C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61E2FCD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61E2DB8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61E2B9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61E27F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61E36D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61e2814635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:01:46.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:02:45.966+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] MongoDB starting : pid=16570 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:02:45.973+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:02:46.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:02:46.286+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737766:286694][16570:0x7f4f1542ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:02:46.286+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:02:46.297+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4f1435e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4F1433D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0626A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4F15015000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4F14E11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4F14B17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4F14902000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4F146E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4F1433D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4F1521E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4f1435e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:02:46.297+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:03:45.585+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] MongoDB starting : pid=16777 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:03:45.593+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:03:45.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:03:45.901+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737825:901341][16777:0x7fc2910bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:03:45.901+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:03:45.911+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc28ffec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC28FFCB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8034E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC290CA3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC290A9F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC2907A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC290590000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC290373000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC28FFCB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC290EAC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc28ffec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:03:45.911+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:04:46.039+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] MongoDB starting : pid=16998 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:04:46.046+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:04:46.097+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:04:46.365+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737886:365649][16998:0x7fc4fa274c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:04:46.365+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:04:46.376+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4f91a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4F9183000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C547000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4F9E5B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4F9C57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4F995D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4F9748000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4F952B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4F9183000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4FA064000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4f91a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:04:46.376+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:05:45.508+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] MongoDB starting : pid=17125 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:05:45.515+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:05:45.567+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:05:45.938+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507737945:938887][17125:0x7f162d0c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:05:45.938+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:05:45.958+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f162bff0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F162BFCF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA14FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F162CCA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F162CAA3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F162C7A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F162C594000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F162C377000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F162BFCF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F162CEB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f162bff0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:05:45.958+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:06:45.432+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] MongoDB starting : pid=17413 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:06:45.440+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:06:45.491+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:06:45.759+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738005:759791][17413:0x7f63e107fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:06:45.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:06:45.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63dffaf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63DFF8E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63E0C66000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63E0A62000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F63E0768000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63E0553000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63E0336000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63DFF8E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F63E0E6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63dffaf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:06:45.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:07:45.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] MongoDB starting : pid=17654 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:07:45.909+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:07:45.959+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:07:46.232+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738066:232584][17654:0x7fec262fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:07:46.232+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:07:46.243+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec2522b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC2520A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF27AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC25EE2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC25CDE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC259E4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC257CF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC255B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC2520A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC260EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec2522b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:07:46.243+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:08:45.885+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] MongoDB starting : pid=17881 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:08:45.894+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:08:45.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:08:45.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:08:45.948+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:08:46.272+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738126:272548][17881:0x7fefe4979c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:08:46.272+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:08:46.292+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fefe38a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFE3888000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7775A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFE4560000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFE435C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFE4062000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFE3E4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFE3C30000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFE3888000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFE4769000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fefe38a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:08:46.292+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:09:45.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=18098 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:09:45.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:09:45.480+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:09:45.802+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738185:802273][18098:0x7f19cd34ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:09:45.802+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:09:45.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19cc27e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19CC25D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19CCF35000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19CCD31000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19CCA37000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19CC822000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19CC605000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19CC25D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19CD13E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19cc27e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:09:45.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:10:45.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] MongoDB starting : pid=18226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:10:45.942+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:10:45.991+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:10:46.323+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738246:323763][18226:0x7f9c4db6ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:10:46.323+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:10:46.343+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c4ca9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C4CA7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C4D755000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C4D551000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C4D257000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C4D042000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C4CE25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C4CA7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C4D95E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c4ca9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:10:46.343+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:11:45.768+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=18510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:11:45.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:11:45.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:11:46.127+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738306:127688][18510:0x7f6646ec1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:11:46.127+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:11:46.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6645df1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6645DD0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5BCBB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6646AA8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F66468A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F66465AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6646395000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6646178000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6645DD0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6646CB1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6645df1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:11:46.147+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:12:45.270+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] MongoDB starting : pid=18826 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:12:45.277+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:12:45.327+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:12:45.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738365:668419][18826:0x7f8456df2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:12:45.668+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:12:45.679+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8455d22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8455D01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91E99000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84569D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84567D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84564DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F84562C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84560A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8455D01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8456BE2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8455d22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:12:45.679+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:13:45.198+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] MongoDB starting : pid=19054 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:13:45.205+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:13:45.255+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:13:45.578+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738425:578881][19054:0x7f0d737a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:13:45.578+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:13:45.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d726d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D726B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D73390000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D7318C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D72E92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D72C7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D72A60000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D726B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D73599000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d726d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:13:45.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:14:45.711+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] MongoDB starting : pid=19277 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:14:45.719+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:14:45.769+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:14:46.075+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738486:75067][19277:0x7f8d60e61c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:14:46.075+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:14:46.086+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d5fd91635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D5FD70000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8AA3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D60A48000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D60844000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D6054A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D60335000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D60118000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D5FD70000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D60C51000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d5fd91635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:14:46.086+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:15:45.206+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] MongoDB starting : pid=19391 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:15:45.214+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:15:45.265+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:15:45.539+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738545:539181][19391:0x7f8e401f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:15:45.539+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:15:45.549+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e3f121635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E3F100000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEBF57000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E3FDD8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E3FBD4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E3F8DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E3F6C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E3F4A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E3F100000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E3FFE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e3f121635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:15:45.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:16:46.050+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] MongoDB starting : pid=19705 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:16:46.057+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:16:46.058+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:16:46.107+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:16:46.421+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738606:421307][19705:0x7fd581e7ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:16:46.421+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:16:46.441+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd580daa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD580D89000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD581A61000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD58185D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD581563000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD58134E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD581131000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD580D89000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD581C6A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd580daa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:16:46.441+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:17:45.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] MongoDB starting : pid=19946 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:17:45.581+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:17:45.631+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:17:45.897+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738665:897577][19946:0x7f6500d4ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:17:45.897+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:17:45.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f64ffc7e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F64FFC5D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9DE81000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6500935000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6500731000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6500437000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6500222000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6500005000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F64FFC5D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6500B3E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f64ffc7e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:17:45.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:18:45.476+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] MongoDB starting : pid=20175 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:18:45.483+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:18:45.535+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:18:45.855+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738725:855723][20175:0x7f3167421c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:18:45.855+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:18:45.867+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3166351635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3166330000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA32C0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3167008000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3166E04000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3166B0A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F31668F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F31666D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3166330000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3167211000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3166351635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:18:45.867+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:19:45.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=20390 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:19:46.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:19:46.053+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:19:46.349+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738786:349826][20390:0x7f6292869c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:19:46.349+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:19:46.360+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6291799635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6291778000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6292450000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F629224C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6291F52000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6291D3D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6291B20000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6291778000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6292659000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6291799635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:19:46.360+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:20:45.484+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=20516 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:20:45.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:20:45.542+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:20:45.844+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738845:844416][20516:0x7feb2ba7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:20:45.844+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:20:45.856+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb2a9ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB2A98C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB2B664000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB2B460000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB2B166000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB2AF51000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB2AD34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB2A98C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB2B86D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb2a9ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:20:45.856+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:21:45.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] MongoDB starting : pid=20800 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:21:45.290+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:21:45.343+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:21:45.624+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738905:624926][20800:0x7fb50e163c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:21:45.624+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:21:45.635+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb50d093635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB50D072000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7013000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB50DD4A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB50DB46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB50D84C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB50D637000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB50D41A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB50D072000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB50DF53000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb50d093635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:21:45.635+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:22:45.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] MongoDB starting : pid=21066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:22:45.769+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:22:45.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:22:46.097+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507738966:97734][21066:0x7f40a82eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:22:46.097+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:22:46.108+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40a721e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40A71FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF974D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40A7ED5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40A7CD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40A79D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40A77C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40A75A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40A71FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40A80DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40a721e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:22:46.108+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:23:45.661+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] MongoDB starting : pid=21287 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:23:45.668+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:23:45.720+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:23:46.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739026:62239][21287:0x7fe7fc035c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:23:46.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:23:46.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7faf65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7FAF44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB2497000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7FBC1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7FBA18000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7FB71E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7FB509000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7FB2EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7FAF44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7FBE25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7faf65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:23:46.081+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:24:45.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=21510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:24:45.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:24:45.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:24:45.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739085:533500][21510:0x7f13b3857c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:24:45.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:24:45.544+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f13b2787635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F13B2766000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F13B343E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F13B323A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F13B2F40000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F13B2D2B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F13B2B0E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F13B2766000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F13B3647000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f13b2787635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:24:45.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:25:45.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:25:45.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=21635 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:25:45.679+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:25:45.733+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:25:46.021+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739146:21043][21635:0x7fcb64e5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:25:46.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:25:46.031+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb63d8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB63D6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB64A44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB64840000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB64546000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB64331000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB64114000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB63D6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB64C4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb63d8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:25:46.031+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:26:45.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:26:45.417+0000 I CONTROL [initandlisten] MongoDB starting : pid=21916 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:26:45.417+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:26:45.417+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:26:45.417+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:26:45.417+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:26:45.418+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:26:45.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:26:45.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:26:45.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:26:45.467+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:26:45.745+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739205:745073][21916:0x7f465a5dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:26:45.745+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:26:45.755+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f465950f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F46594EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F465A1C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4659FC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4659CC8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4659AB3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4659896000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F46594EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F465A3CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f465950f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:26:45.755+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:27:45.897+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] MongoDB starting : pid=22149 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:27:45.905+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:27:45.958+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:27:46.264+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739266:264945][22149:0x7fb9486eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:27:46.265+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:27:46.275+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb94761e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB9475FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB9482D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB9480D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB947DD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB947BC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9479A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB9475FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB9484DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb94761e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:27:46.275+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:28:45.858+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] MongoDB starting : pid=22387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:28:45.866+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:28:45.916+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:28:46.180+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739326:180239][22387:0x7f2012b04c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:28:46.180+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:28:46.190+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2011a34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2011A13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7028A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F20126EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F20124E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20121ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2011FD8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2011DBB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2011A13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F20128F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2011a34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:28:46.190+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:29:45.318+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:29:45.325+0000 I CONTROL [initandlisten] MongoDB starting : pid=22596 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:29:45.326+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:29:45.376+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:29:45.737+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739385:737398][22596:0x7f137b280c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:29:45.737+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:29:45.757+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f137a1b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F137A18F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F137AE67000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F137AC63000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F137A969000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F137A754000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F137A537000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F137A18F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F137B070000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f137a1b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:29:45.757+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:30:45.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:30:45.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=22714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:30:45.883+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:30:45.933+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:30:46.189+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739446:189225][22714:0x7fd343b31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:30:46.189+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:30:46.199+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd342a61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD342A40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF75014000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD343718000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD343514000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD34321A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD343005000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD342DE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD342A40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD343921000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd342a61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:30:46.199+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:31:45.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=22987 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:31:45.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:31:45.640+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:31:45.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739505:911841][22987:0x7fc09ff81c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:31:45.911+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:31:45.922+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc09eeb1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC09EE90000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC09FB68000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC09F964000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC09F66A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC09F455000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC09F238000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC09EE90000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC09FD71000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc09eeb1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:31:45.922+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:32:46.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=23220 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:32:46.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:32:46.100+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:32:46.386+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739566:386829][23220:0x7ff15e37fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:32:46.386+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:32:46.397+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff15d2af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF15D28E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F476000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF15DF66000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF15DD62000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF15DA68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF15D853000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF15D636000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF15D28E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF15E16F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff15d2af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:32:46.397+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:33:45.425+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] MongoDB starting : pid=23424 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:33:45.433+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:33:45.484+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:33:45.835+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739625:835595][23424:0x7f3607101c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:33:45.835+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:33:45.855+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3606031635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3606010000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF756E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3606CE8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3606AE4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36067EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36065D5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36063B8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3606010000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3606EF1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3606031635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:33:45.855+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:34:45.981+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] MongoDB starting : pid=23588 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:34:45.988+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:34:46.039+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:34:46.328+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739686:328081][23588:0x7f490eedec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:34:46.328+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:34:46.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f490de0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F490DDED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC96A4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F490EAC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F490E8C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F490E5C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F490E3B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F490E195000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F490DDED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F490ECCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f490de0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:34:46.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:35:45.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:35:45.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=23797 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:35:45.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:35:45.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:35:45.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:35:45.470+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:35:45.471+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:35:45.471+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:35:45.471+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:35:45.471+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:35:45.521+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:35:45.789+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739745:789728][23797:0x7fa19a51cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:35:45.789+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:35:45.800+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa19944c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA19942B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFFEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA19A103000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA199EFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA199C05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1999F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1997D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA19942B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA19A30C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa19944c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:35:45.800+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:36:45.279+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] MongoDB starting : pid=23922 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:36:45.286+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:36:45.338+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:36:45.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739805:724666][23922:0x7fda0f4f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:36:45.724+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:36:45.744+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda0e429635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA0E408000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61A6B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA0F0E0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA0EEDC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA0EBE2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA0E9CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA0E7B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA0E408000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA0F2E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda0e429635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:36:45.744+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:37:45.867+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] MongoDB starting : pid=24205 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:37:45.875+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:37:45.924+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:37:46.230+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739866:230422][24205:0x7f074bdadc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:37:46.230+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:37:46.240+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f074acdd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F074ACBC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95DCA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F074B994000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F074B790000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F074B496000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F074B281000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F074B064000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F074ACBC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F074BB9D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f074acdd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:37:46.240+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:38:45.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=24575 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:38:45.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:38:45.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:38:46.332+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739926:332246][24575:0x7f72d5415c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:38:46.332+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:38:46.351+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f72d4345635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F72D4324000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF430FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F72D4FFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F72D4DF8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F72D4AFE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F72D48E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F72D46CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F72D4324000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F72D5205000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f72d4345635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:38:46.351+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:39:45.481+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:39:45.489+0000 I CONTROL [initandlisten] MongoDB starting : pid=24784 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:39:45.489+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:39:45.489+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:39:45.489+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:39:45.489+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:39:45.489+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:39:45.490+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:39:45.490+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:39:45.490+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:39:45.540+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:39:45.892+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507739985:892593][24784:0x7f6355220c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:39:45.892+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:39:45.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6354150635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F635412F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6354E07000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6354C03000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6354909000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63546F4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63544D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F635412F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6355010000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6354150635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:39:45.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:40:46.022+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] MongoDB starting : pid=24998 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:40:46.030+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:40:46.080+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:40:46.435+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740046:435048][24998:0x7f205b68dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:40:46.435+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:40:46.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f205a5bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F205A59C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF11C48000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F205B274000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F205B070000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F205AD76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F205AB61000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F205A944000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F205A59C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F205B47D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f205a5bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:40:46.455+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:41:45.834+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] MongoDB starting : pid=25122 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:41:45.843+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:41:45.896+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:41:46.182+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740106:182478][25122:0x7f195092ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:41:46.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:41:46.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f194f85a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F194F839000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9BAE0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1950511000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F195030D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1950013000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F194FDFE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F194FBE1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F194F839000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F195071A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f194f85a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:41:46.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:42:45.313+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] MongoDB starting : pid=25407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:42:45.321+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:42:45.370+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:42:45.705+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740165:705681][25407:0x7fbb57e3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:42:45.705+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:42:45.716+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb56d6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB56D49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF542E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB57A21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB5781D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB57523000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB5730E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB570F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB56D49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB57C2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb56d6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:42:45.716+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:43:45.093+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:43:45.100+0000 I CONTROL [initandlisten] MongoDB starting : pid=25862 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:43:45.100+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:43:45.100+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:43:45.100+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:43:45.100+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:43:45.101+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:43:45.101+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:43:45.101+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:43:45.101+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:43:45.150+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:43:45.401+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740225:401937][25862:0x7f00bc439c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:43:45.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:43:45.412+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00bb369635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00BB348000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF018FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00BC020000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00BBE1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00BBB22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00BB90D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00BB6F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00BB348000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00BC229000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00bb369635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:43:45.412+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:44:45.542+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] MongoDB starting : pid=26083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:44:45.549+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:44:45.599+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:44:46.012+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740286:12009][26083:0x7f457e478c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:44:46.012+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:44:46.024+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f457d3a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F457D387000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC855000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F457E05F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F457DE5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F457DB61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F457D94C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F457D72F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F457D387000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F457E268000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f457d3a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:44:46.025+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:45:45.145+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] MongoDB starting : pid=26305 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:45:45.152+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:45:45.202+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:45:45.512+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740345:512868][26305:0x7ff47fcacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:45:45.512+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:45:45.524+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff47ebdc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF47EBBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF96EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF47F893000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF47F68F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF47F395000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF47F180000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF47EF63000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF47EBBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF47FA9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff47ebdc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:45:45.524+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:46:45.936+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] MongoDB starting : pid=27014 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:46:45.943+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:46:45.996+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:46:46.322+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740406:322199][27014:0x7fd5dbf57c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:46:46.322+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:46:46.341+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5dae87635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5DAE66000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF332FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD5DBB3E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5DB93A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5DB640000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5DB42B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5DB20E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5DAE66000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5DBD47000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5dae87635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:46:46.341+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:47:45.466+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] MongoDB starting : pid=27532 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:47:45.474+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:47:45.526+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:47:45.938+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740465:938568][27532:0x7f6cbd3ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:47:45.938+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:47:45.958+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6cbc31b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6CBC2FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6CBCFD2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6CBCDCE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6CBCAD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6CBC8BF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6CBC6A2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6CBC2FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6CBD1DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6cbc31b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:47:45.959+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:48:45.671+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=28087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:48:45.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:48:45.727+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:48:46.035+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740526:35373][28087:0x7fa3c3658c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:48:46.035+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:48:46.054+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa3c2588635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3C2567000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94084000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3C323F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3C303B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3C2D41000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3C2B2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3C290F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3C2567000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3C3448000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa3c2588635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:48:46.054+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:49:45.187+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] MongoDB starting : pid=28597 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:49:45.194+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:49:45.246+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:49:45.584+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740585:584104][28597:0x7f6f5ac17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:49:45.584+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:49:45.594+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f59b47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F59B26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD02D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F5A7FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F5A5FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F5A300000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F5A0EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F59ECE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F59B26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F5AA07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f59b47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:49:45.594+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:50:45.722+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] MongoDB starting : pid=28901 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:50:45.729+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:50:45.779+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:50:46.059+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740646:59365][28901:0x7f2c5a5afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:50:46.059+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:50:46.070+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c594df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C594BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6AAF9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C5A196000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C59F92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C59C98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C59A83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C59866000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C594BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C5A39F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c594df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:50:46.070+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:51:45.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=29205 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:51:45.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:51:45.548+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:51:45.920+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740705:920161][29205:0x7fce9d504c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:51:45.920+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:51:45.940+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce9c434635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE9C413000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE9D0EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE9CEE7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE9CBED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE9C9D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE9C7BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE9C413000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE9D2F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce9c434635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:51:45.940+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:52:45.063+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] MongoDB starting : pid=29498 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:52:45.071+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:52:45.121+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:52:45.491+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740765:491961][29498:0x7f0dbba11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:52:45.492+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:52:45.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0dba941635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0DBA920000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF65E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0DBB5F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0DBB3F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0DBB0FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0DBAEE5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0DBACC8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0DBA920000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0DBB801000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0dba941635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:52:45.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:53:45.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=29771 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:53:45.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:53:45.855+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:53:46.159+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740826:159801][29771:0x7f8357549c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:53:46.159+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:53:46.170+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8356479635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8356458000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8357130000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8356F2C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8356C32000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8356A1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8356800000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8356458000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8357339000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8356479635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:53:46.170+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:54:45.298+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:54:45.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=30077 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:54:45.306+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:54:45.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:54:45.602+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740885:602790][30077:0x7ffc0f174c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:54:45.602+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:54:45.613+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc0e0a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC0E083000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF724FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC0ED5B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC0EB57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC0E85D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC0E648000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC0E42B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC0E083000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC0EF64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc0e0a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:54:45.613+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:55:45.741+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] MongoDB starting : pid=30490 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:55:45.750+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:55:45.801+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:55:46.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507740946:158377][30490:0x7fddf85bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:55:46.158+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:55:46.177+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fddf74ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDDF74CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDDF81A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDDF7FA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDDF7CA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDDF7A92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDDF7875000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDDF74CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDDF83AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fddf74ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:55:46.177+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:56:45.580+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] MongoDB starting : pid=30620 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:56:45.588+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:56:45.639+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:56:45.921+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741005:921323][30620:0x7f244724ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:56:45.921+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:56:45.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f244617e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F244615D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2446E35000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2446C31000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2446937000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2446722000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2446505000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F244615D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F244703E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f244617e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:56:45.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:57:45.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:57:45.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=30947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:57:45.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:57:45.100+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:57:45.396+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741065:396165][30947:0x7f3aaf441c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:57:45.396+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:57:45.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3aae371635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3AAE350000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF320FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3AAF028000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3AAEE24000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3AAEB2A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3AAE915000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3AAE6F8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3AAE350000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3AAF231000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3aae371635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:57:45.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:58:45.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=31233 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:58:45.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:58:45.956+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:58:46.214+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741126:214735][31233:0x7f2bccecbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:58:46.214+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:58:46.225+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2bcbdfb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2BCBDDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0DCA6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2BCCAB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2BCC8AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2BCC5B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2BCC39F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2BCC182000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2BCBDDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2BCCCBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2bcbdfb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:58:46.225+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T16:59:45.360+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] MongoDB starting : pid=31538 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] modules: none 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] build environment: 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T16:59:45.367+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T16:59:45.418+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T16:59:45.738+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741185:738513][31538:0x7fec39255c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T16:59:45.738+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T16:59:45.748+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec38185635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC38164000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C4BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC38E3C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC38C38000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC3893E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC38729000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC3850C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC38164000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC39045000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec38185635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T16:59:45.749+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:00:45.878+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] MongoDB starting : pid=31782 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:00:45.885+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:00:45.937+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:00:46.197+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741246:197909][31782:0x7f467353bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:00:46.197+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:00:46.208+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f467246b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F467244A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19557000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4673122000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4672F1E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4672C24000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4672A0F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F46727F2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F467244A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F467332B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f467246b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:00:46.208+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:01:45.677+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] MongoDB starting : pid=31939 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:01:45.686+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:01:45.737+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:01:46.089+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741306:89528][31939:0x7fadfd36bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:01:46.089+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:01:46.109+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fadfc29b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FADFC27A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B4B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FADFCF52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FADFCD4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FADFCA54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FADFC83F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FADFC622000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FADFC27A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FADFD15B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fadfc29b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:01:46.110+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:02:45.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] MongoDB starting : pid=32254 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:02:45.694+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:02:45.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:02:45.745+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:02:46.068+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741366:68301][32254:0x7f8e14d67c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:02:46.068+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:02:46.078+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e13c97635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E13C76000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEDA61000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E1494E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E1474A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E14450000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E1423B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E1401E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E13C76000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E14B57000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e13c97635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:02:46.078+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:03:45.345+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=32518 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:03:45.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:03:45.403+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:03:45.712+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741425:712244][32518:0x7fd639476c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:03:45.712+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:03:45.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd6383a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD638385000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD63905D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD638E59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD638B5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD63894A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD63872D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD638385000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD639266000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd6383a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:03:45.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:04:45.847+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] MongoDB starting : pid=32759 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:04:45.854+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:04:45.909+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:04:46.228+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741486:228960][32759:0x7f80a7b5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:04:46.229+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:04:46.239+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80a6a8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80A6A6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF481CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80A7744000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80A7540000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80A7246000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80A7031000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80A6E14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80A6A6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80A794D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80a6a8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:04:46.239+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:05:45.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] MongoDB starting : pid=519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:05:45.379+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:05:45.430+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:05:45.816+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741545:816087][519:0x7f8977922c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:05:45.816+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:05:45.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8976852635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8976831000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8977509000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8977305000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F897700B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8976DF6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8976BD9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8976831000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8977712000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8976852635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:05:45.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:06:45.231+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:06:45.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=672 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:06:45.239+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:06:45.290+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:06:45.570+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741605:570295][672:0x7fac1c314c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:06:45.570+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:06:45.580+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac1b244635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC1B223000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC1BEFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC1BCF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC1B9FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC1B7E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC1B5CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC1B223000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC1C104000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac1b244635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:06:45.580+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:07:45.708+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] MongoDB starting : pid=976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:07:45.716+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:07:45.771+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:07:46.066+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741666:66364][976:0x7fe2ea08bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:07:46.066+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:07:46.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2e8fbb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2E8F9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF388FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2E9C72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2E9A6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2E9774000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2E955F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2E9342000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2E8F9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2E9E7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2e8fbb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:07:46.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:08:45.779+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] MongoDB starting : pid=1242 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:08:45.787+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:08:45.838+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:08:46.102+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741726:102569][1242:0x7f0a17a76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:08:46.102+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:08:46.113+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a169a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A16985000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4A4F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A1765D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A17459000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A1715F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A16F4A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A16D2D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A16985000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A17866000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a169a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:08:46.113+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:09:45.231+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:09:45.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=1397 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:09:45.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:09:45.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:09:45.239+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:09:45.239+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:09:45.239+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:09:45.239+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:09:45.239+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:09:45.239+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:09:45.289+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:09:45.581+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741785:581195][1397:0x7f896d0f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:09:45.581+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:09:45.591+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f896c024635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F896C003000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF352E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F896CCDB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F896CAD7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F896C7DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F896C5C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F896C3AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F896C003000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F896CEE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f896c024635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:09:45.591+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:10:45.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] MongoDB starting : pid=1634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:10:45.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:10:45.783+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:10:46.069+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741846:69226][1634:0x7f0949e99c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:10:46.069+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:10:46.079+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0948dc9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0948DA8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0949A80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F094987C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0949582000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F094936D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0949150000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0948DA8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0949C89000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0948dc9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:10:46.079+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:11:45.517+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=1873 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:11:45.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:11:45.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:11:45.859+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741905:859610][1873:0x7f186ce4cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:11:45.859+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:11:45.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f186bd7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F186BD5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC88A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F186CA33000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F186C82F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F186C535000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F186C320000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F186C103000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F186BD5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F186CC3C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f186bd7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:11:45.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:12:45.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=2042 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:12:46.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:12:46.053+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:12:46.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507741966:370572][2042:0x7f7064c17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:12:46.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:12:46.391+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7063b47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7063B26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF948FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F70647FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F70645FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7064300000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F70640EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7063ECE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7063B26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7064A07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7063b47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:12:46.391+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:13:45.877+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] MongoDB starting : pid=2385 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:13:45.885+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:13:45.936+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:13:46.262+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742026:262218][2385:0x7f1c56495c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:13:46.262+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:13:46.272+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c553c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C553A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF748F1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C5607C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C55E78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C55B7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C55969000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C5574C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C553A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C56285000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c553c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:13:46.272+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:14:45.390+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] MongoDB starting : pid=2630 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:14:45.397+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:14:45.448+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:14:45.785+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742085:785650][2630:0x7f88b87fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:14:45.785+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:14:45.797+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88b772d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88B770C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9270000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F88B83E4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88B81E0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88B7EE6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88B7CD1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88B7AB4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88B770C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F88B85ED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88b772d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:14:45.797+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:15:45.930+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] MongoDB starting : pid=2868 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:15:45.937+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:15:45.987+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:15:46.341+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742146:341306][2868:0x7f0138e5ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:15:46.341+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:15:46.352+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0137d8e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0137D6D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B6A1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0138A45000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0138841000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0138547000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0138332000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0138115000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0137D6D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0138C4E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0137d8e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:15:46.352+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:16:45.753+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] MongoDB starting : pid=3115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:16:45.761+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:16:45.813+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:16:46.197+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742206:197312][3115:0x7f14bae60c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:16:46.197+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:16:46.216+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14b9d90635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14B9D6F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F14BAA47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F14BA843000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F14BA549000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F14BA334000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F14BA117000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14B9D6F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F14BAC50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14b9d90635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:16:46.216+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:17:45.337+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:17:45.344+0000 I CONTROL [initandlisten] MongoDB starting : pid=3282 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:17:45.344+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:17:45.344+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:17:45.344+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:17:45.345+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:17:45.345+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:17:45.345+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:17:45.345+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:17:45.345+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:17:45.394+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:17:45.709+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742265:709617][3282:0x7fdf0962dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:17:45.709+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:17:45.729+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf0855d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF0853C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF235DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF09214000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF09010000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF08D16000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF08B01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF088E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF0853C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF0941D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf0855d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:17:45.729+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:18:45.260+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:18:45.267+0000 I CONTROL [initandlisten] MongoDB starting : pid=3613 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:18:45.267+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:18:45.267+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:18:45.267+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:18:45.268+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:18:45.268+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:18:45.268+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:18:45.268+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:18:45.268+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:18:45.320+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:18:45.693+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742325:693777][3613:0x7fa741881c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:18:45.693+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:18:45.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7407b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA740790000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA741468000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA741264000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA740F6A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA740D55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA740B38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA740790000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA741671000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7407b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:18:45.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:19:45.847+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] MongoDB starting : pid=3854 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:19:45.854+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:19:45.904+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:19:46.196+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742386:196702][3854:0x7f182d296c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:19:46.196+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:19:46.207+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f182c1c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F182C1A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFBEF9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F182CE7D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F182CC79000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F182C97F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F182C76A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F182C54D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F182C1A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F182D086000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f182c1c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:19:46.207+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:20:45.331+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] MongoDB starting : pid=4092 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:20:45.338+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:20:45.388+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:20:45.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742445:702167][4092:0x7faf6c98ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:20:45.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:20:45.721+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf6b8ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF6B899000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2689000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF6C571000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF6C36D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF6C073000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF6BE5E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF6BC41000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF6B899000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF6C77A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf6b8ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:20:45.721+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:21:45.118+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] MongoDB starting : pid=4324 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:21:45.126+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:21:45.175+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:21:45.458+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742505:458731][4324:0x7f376666cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:21:45.458+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:21:45.469+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f376559c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F376557B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3766253000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F376604F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3765D55000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3765B40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3765923000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F376557B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F376645C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f376559c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:21:45.469+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:22:45.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:22:45.606+0000 I CONTROL [initandlisten] MongoDB starting : pid=4491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:22:45.607+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:22:45.658+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:22:45.968+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742565:968227][4491:0x7fc6dd322c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:22:45.968+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:22:45.978+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6dc252635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6DC231000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF646DE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6DCF09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6DCD05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6DCA0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6DC7F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC6DC5D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6DC231000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC6DD112000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6dc252635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:22:45.978+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:23:45.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=4828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:23:45.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:23:45.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:23:45.616+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742625:616286][4828:0x7f43e96e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:23:45.616+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:23:45.627+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f43e8610635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F43E85EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A875000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F43E92C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F43E90C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F43E8DC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43E8BB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F43E8997000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F43E85EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F43E94D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f43e8610635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:23:45.627+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:24:45.746+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] MongoDB starting : pid=5280 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:24:45.754+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:24:45.804+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:24:46.101+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742686:101054][5280:0x7f870384cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:24:46.101+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:24:46.111+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f870277c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F870275B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8703433000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F870322F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8702F35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8702D20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8702B03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F870275B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F870363C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f870277c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:24:46.111+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:25:45.251+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] MongoDB starting : pid=5624 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:25:45.258+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:25:45.309+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:25:45.592+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742745:592159][5624:0x7f1a06248c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:25:45.592+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:25:45.602+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a05178635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A05157000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF346FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A05E2F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A05C2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A05931000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A0571C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A054FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A05157000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A06038000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a05178635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:25:45.602+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:26:45.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=6021 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:26:45.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:26:45.116+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:26:45.372+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742805:372080][6021:0x7fc868f24c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:26:45.372+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:26:45.382+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc867e54635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC867E33000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60F4C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC868B0B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC868907000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC86860D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8683F8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8681DB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC867E33000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC868D14000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc867e54635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:26:45.382+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:27:45.529+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] MongoDB starting : pid=6281 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:27:45.537+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:27:45.587+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:27:45.913+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742865:913221][6281:0x7f95d6939c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:27:45.913+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:27:45.932+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f95d5869635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F95D5848000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F95D6520000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F95D631C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F95D6022000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F95D5E0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F95D5BF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F95D5848000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F95D6729000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f95d5869635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:27:45.932+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:28:45.438+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] MongoDB starting : pid=6721 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:28:45.446+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:28:45.497+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:28:45.759+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742925:759622][6721:0x7f673eb2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:28:45.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:28:45.770+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f673da5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F673DA3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F6DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F673E713000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F673E50F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F673E215000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F673E000000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F673DDE3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F673DA3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F673E91C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f673da5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:28:45.770+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:29:45.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=7049 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:29:45.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:29:45.957+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:29:46.330+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507742986:330424][7049:0x7fe38ebd5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:29:46.330+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:29:46.350+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe38db05635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE38DAE4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF290FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE38E7BC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE38E5B8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE38E2BE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE38E0A9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE38DE8C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE38DAE4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE38E9C5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe38db05635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:29:46.350+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:30:45.509+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] MongoDB starting : pid=7331 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:30:45.517+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:30:45.567+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:30:45.914+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743045:913999][7331:0x7feff4f7ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:30:45.914+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:30:45.933+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feff3eaa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFF3E89000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFF4B61000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFF495D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFF4663000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFF444E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFF4231000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFF3E89000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFF4D6A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feff3eaa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:30:45.933+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:31:45.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:31:45.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=7543 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:31:45.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:31:45.411+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:31:45.753+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743105:753187][7543:0x7f9b2ff42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:31:45.753+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:31:45.763+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b2ee72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B2EE51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E2AE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B2FB29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B2F925000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B2F62B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B2F416000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B2F1F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B2EE51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B2FD32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b2ee72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:31:45.763+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:32:45.886+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] MongoDB starting : pid=7685 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:32:45.894+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:32:45.944+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:32:46.290+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743166:290299][7685:0x7f0259eb3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:32:46.290+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:32:46.309+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0258de3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0258DC2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF290FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0259A9A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0259896000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F025959C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0259387000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F025916A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0258DC2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0259CA3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0258de3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:32:46.309+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:33:45.424+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=7973 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:33:45.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:33:45.486+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:33:45.769+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743225:768994][7973:0x7fbf4e81dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:33:45.769+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:33:45.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbf4d74d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBF4D72C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF176FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBF4E404000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBF4E200000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBF4DF06000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBF4DCF1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBF4DAD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBF4D72C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBF4E60D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbf4d74d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:33:45.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:34:45.908+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] MongoDB starting : pid=8181 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:34:45.915+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:34:45.965+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:34:46.294+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743286:294844][8181:0x7ffaf8dc6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:34:46.294+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:34:46.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffaf7cf6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFAF7CD5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFAF89AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFAF87A9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFAF84AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFAF829A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFAF807D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFAF7CD5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFAF8BB6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffaf7cf6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:34:46.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:35:45.448+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] MongoDB starting : pid=8409 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:35:45.455+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:35:45.506+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:35:45.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743345:751872][8409:0x7f90063a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:35:45.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:35:45.771+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90052d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90052B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85E9A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9005F88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9005D84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9005A8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9005875000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9005658000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90052B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9006191000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90052d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:35:45.771+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:36:45.159+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] MongoDB starting : pid=8897 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:36:45.166+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:36:45.216+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:36:45.553+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743405:553096][8897:0x7f99f5decc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:36:45.553+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:36:45.572+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99f4d1c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99F4CFB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0402000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99F59D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99F57CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99F54D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99F52C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99F50A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99F4CFB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99F5BDC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99f4d1c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:36:45.572+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:37:45.691+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] MongoDB starting : pid=9179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:37:45.698+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:37:45.748+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:37:46.085+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743466:85758][9179:0x7f5949060c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:37:46.085+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:37:46.105+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5947f90635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5947F6F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95257000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5948C47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5948A43000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5948749000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5948534000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5948317000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5947F6F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5948E50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5947f90635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:37:46.105+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:38:45.223+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] MongoDB starting : pid=9626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:38:45.230+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:38:45.280+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:38:45.528+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743525:528953][9626:0x7f8f23ae5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:38:45.529+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:38:45.539+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f22a15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F229F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F236CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F234C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F231CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F22FB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F22D9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F229F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F238D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f22a15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:38:45.539+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:39:45.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=9827 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:39:45.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:39:45.880+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:39:46.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743586:153532][9827:0x7f04a4177c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:39:46.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:39:46.164+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04a30a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04A3086000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF446FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04A3D5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04A3B5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04A3860000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04A364B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04A342E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04A3086000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04A3F67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04a30a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:39:46.164+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:40:45.282+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] MongoDB starting : pid=10362 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:40:45.289+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:40:45.339+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:40:45.619+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743645:619829][10362:0x7f194b91dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:40:45.619+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:40:45.630+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f194a84d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F194A82C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAAAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F194B504000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F194B300000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F194B006000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F194ADF1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F194ABD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F194A82C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F194B70D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f194a84d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:40:45.630+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:41:46.054+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] MongoDB starting : pid=10640 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:41:46.061+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:41:46.111+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:41:46.403+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743706:403629][10640:0x7fa397c89c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:41:46.403+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:41:46.423+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa396bb9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA396B98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA397870000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA39766C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA397372000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA39715D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA396F40000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA396B98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA397A79000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa396bb9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:41:46.423+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:42:45.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=10792 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:42:45.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:42:45.628+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:42:45.979+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743765:979640][10792:0x7f301101fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:42:45.979+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:42:45.990+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f300ff4f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F300FF2E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3010C06000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3010A02000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3010708000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F30104F3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F30102D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F300FF2E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3010E0F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f300ff4f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:42:45.990+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:43:45.138+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] MongoDB starting : pid=11221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:43:45.145+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:43:45.195+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:43:45.582+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743825:582512][11221:0x7fa1de142c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:43:45.582+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:43:45.602+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1dd072635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1DD051000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0774000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1DDD29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1DDB25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1DD82B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1DD616000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1DD3F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1DD051000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1DDF32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1dd072635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:43:45.602+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:44:45.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] MongoDB starting : pid=11387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:44:45.921+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:44:45.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:44:46.239+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743886:239319][11387:0x7fc45b5dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:44:46.239+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:44:46.249+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc45a50b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC45A4EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC45B1C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC45AFBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC45ACC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC45AAAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC45A892000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC45A4EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC45B3CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc45a50b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:44:46.249+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:45:45.374+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:45:45.381+0000 I CONTROL [initandlisten] MongoDB starting : pid=11728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:45:45.382+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:45:45.431+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:45:45.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507743945:707099][11728:0x7fc4b3c7ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:45:45.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:45:45.718+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4b2bae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4B2B8D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4B3865000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4B3661000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4B3367000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4B3152000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4B2F35000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4B2B8D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4B3A6E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4b2bae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:45:45.718+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:46:45.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=12060 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:46:45.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:46:45.259+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:46:45.521+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744005:521098][12060:0x7f200f847c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:46:45.521+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:46:45.531+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f200e777635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F200E756000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63E60000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F200F42E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F200F22A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F200EF30000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F200ED1B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F200EAFE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F200E756000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F200F637000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f200e777635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:46:45.531+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:47:45.654+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] MongoDB starting : pid=12294 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:47:45.661+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:47:45.710+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:47:45.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744065:994121][12294:0x7f89e6a48c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:47:45.994+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:47:46.004+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f89e5978635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F89E5957000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF276FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F89E662F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F89E642B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F89E6131000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F89E5F1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F89E5CFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F89E5957000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F89E6838000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f89e5978635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:47:46.004+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:48:45.136+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] MongoDB starting : pid=12539 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:48:45.143+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:48:45.192+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:48:45.451+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744125:451255][12539:0x7fb3d84cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:48:45.451+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:48:45.461+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb3d73fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB3D73D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF526CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB3D80B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB3D7EAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB3D7BB3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB3D799E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB3D7781000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB3D73D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB3D82BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb3d73fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:48:45.461+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:49:45.134+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] MongoDB starting : pid=13056 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:49:45.142+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:49:45.191+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:49:45.543+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744185:543661][13056:0x7f6050b8ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:49:45.543+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:49:45.563+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f604fabe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F604FA9D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF131EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6050775000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6050571000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6050277000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6050062000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F604FE45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F604FA9D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F605097E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f604fabe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:49:45.563+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:50:45.697+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] MongoDB starting : pid=13521 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:50:45.708+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:50:45.762+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:50:46.089+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744246:89506][13521:0x7fabfac60c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:50:46.089+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:50:46.109+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabf9b90635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABF9B6F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC76C7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABFA847000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABFA643000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABFA349000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABFA134000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABF9F17000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABF9B6F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABFAA50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabf9b90635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:50:46.109+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:51:45.610+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] MongoDB starting : pid=13989 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:51:45.617+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:51:45.669+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:51:45.968+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744305:968157][13989:0x7fa10c462c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:51:45.968+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:51:45.986+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa10b392635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA10B371000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA10C049000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA10BE45000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA10BB4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA10B936000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA10B719000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA10B371000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA10C252000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa10b392635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:51:45.986+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:52:45.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=14807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:52:45.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:52:45.172+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:52:45.462+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744365:462378][14807:0x7f46d8987c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:52:45.462+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:52:45.482+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f46d78b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F46D7896000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF056FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F46D856E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F46D836A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F46D8070000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F46D7E5B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F46D7C3E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F46D7896000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F46D8777000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f46d78b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:52:45.482+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:53:45.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] MongoDB starting : pid=15250 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:53:45.626+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:53:45.676+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:53:45.926+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744425:926875][15250:0x7fbd65b94c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:53:45.926+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:53:45.937+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbd64ac4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBD64AA3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92562000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBD6577B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBD65577000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBD6527D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBD65068000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBD64E4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBD64AA3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBD65984000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbd64ac4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:53:45.937+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:54:45.314+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] MongoDB starting : pid=15642 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:54:45.321+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:54:45.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:54:45.630+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744485:630950][15642:0x7f6403577c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:54:45.631+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:54:45.641+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f64024a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6402486000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF028FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F640315E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6402F5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6402C60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6402A4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F640282E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6402486000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6403367000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f64024a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:54:45.641+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:55:45.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] MongoDB starting : pid=15907 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:55:45.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:55:45.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:55:45.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:55:46.131+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744546:131965][15907:0x7fe352ef2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:55:46.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:55:46.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe351e22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE351E01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4751C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE352AD9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE3528D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE3525DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE3523C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE3521A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE351E01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE352CE2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe351e22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:55:46.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:56:45.562+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] MongoDB starting : pid=16304 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:56:45.569+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:56:45.570+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:56:45.619+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:56:45.902+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744605:902779][16304:0x7f2da800fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:56:45.902+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:56:45.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2da6f3f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2DA6F1E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFC4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2DA7BF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2DA79F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2DA76F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2DA74E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2DA72C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2DA6F1E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2DA7DFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2da6f3f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:56:45.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:57:46.030+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] MongoDB starting : pid=16527 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:57:46.038+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:57:46.089+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:57:46.470+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744666:470503][16527:0x7fc784bafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:57:46.470+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:57:46.490+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc783adf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC783ABE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A254000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC784796000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC784592000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC784298000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC784083000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC783E66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC783ABE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC78499F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc783adf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:57:46.490+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:58:45.616+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:58:45.623+0000 I CONTROL [initandlisten] MongoDB starting : pid=16689 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:58:45.624+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:58:45.676+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:58:46.026+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744726:26852][16689:0x7f245bbd5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:58:46.026+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:58:46.037+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f245ab05635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F245AAE4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F245B7BC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F245B5B8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F245B2BE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F245B0A9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F245AE8C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F245AAE4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F245B9C5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f245ab05635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:58:46.037+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T17:59:45.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=17096 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] modules: none 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] build environment: 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T17:59:45.882+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T17:59:45.932+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T17:59:46.260+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744786:260063][17096:0x7fa130768c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T17:59:46.260+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T17:59:46.280+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa12f698635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA12F677000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF648FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA13034F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA13014B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA12FE51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA12FC3C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA12FA1F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA12F677000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA130558000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa12f698635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T17:59:46.280+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:00:45.552+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] MongoDB starting : pid=17591 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:00:45.560+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:00:45.614+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:00:45.997+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744845:997362][17591:0x7fe712965c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:00:45.997+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:00:46.017+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe711895635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE711874000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD87B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE71254C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE712348000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE71204E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE711E39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE711C1C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE711874000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE712755000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe711895635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:00:46.017+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:01:45.474+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] MongoDB starting : pid=17832 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:01:45.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:01:45.532+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:01:45.868+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744905:868702][17832:0x7f4383322c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:01:45.868+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:01:45.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4382252635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4382231000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4BA06000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4382F09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4382D05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4382A0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43827F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F43825D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4382231000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4383112000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4382252635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:01:45.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:02:45.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] MongoDB starting : pid=18058 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:02:45.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:02:45.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:02:45.469+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:02:45.832+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507744965:831997][18058:0x7f24c9919c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:02:45.832+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:02:45.851+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24c8849635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24C8828000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F24C9500000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F24C92FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F24C9002000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F24C8DED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F24C8BD0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24C8828000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24C9709000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24c8849635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:02:45.851+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:03:45.971+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=18211 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:03:45.979+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:03:46.028+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:03:46.299+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745026:299076][18211:0x7f752c6b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:03:46.299+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:03:46.309+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f752b5e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F752B5BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF46AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F752C297000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F752C093000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F752BD99000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F752BB84000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F752B967000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F752B5BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F752C4A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f752b5e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:03:46.309+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:04:45.131+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=18473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:04:45.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:04:45.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:04:45.505+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745085:505563][18473:0x7faa6e3fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:04:45.505+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:04:45.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa6d32d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA6D30C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA6DFE4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA6DDE0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA6DAE6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA6D8D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA6D6B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA6D30C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA6E1ED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa6d32d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:04:45.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:05:45.654+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:05:45.661+0000 I CONTROL [initandlisten] MongoDB starting : pid=18685 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:05:45.661+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:05:45.662+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:05:45.711+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:05:46.043+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745146:43173][18685:0x7f2cc2799c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:05:46.043+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:05:46.065+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2cc16c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CC16A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CC2380000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CC217C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CC1E82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CC1C6D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CC1A50000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CC16A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CC2589000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2cc16c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:05:46.065+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:06:45.452+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=18900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:06:45.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:06:45.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:06:45.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745205:787881][18900:0x7f8aa8aefc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:06:45.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:06:45.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8aa7a1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8AA79FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8AA86D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8AA84D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8AA81D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8AA7FC3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8AA7DA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8AA79FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8AA88DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8aa7a1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:06:45.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:07:45.943+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] MongoDB starting : pid=19135 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:07:45.951+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:07:46.004+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:07:46.329+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745266:329080][19135:0x7fcdba038c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:07:46.329+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:07:46.339+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcdb8f68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCDB8F47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14EAA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCDB9C1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCDB9A1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCDB9721000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCDB950C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCDB92EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCDB8F47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCDB9E28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcdb8f68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:07:46.339+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:08:45.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] MongoDB starting : pid=19286 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:08:45.476+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:08:45.526+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:08:45.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745325:805248][19286:0x7f2c3835fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:08:45.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:08:45.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c3728f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C3726E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79AD1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C37F46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C37D42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C37A48000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C37833000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C37616000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C3726E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C3814F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c3728f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:08:45.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:09:45.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] MongoDB starting : pid=19541 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:09:45.281+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:09:45.331+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:09:45.629+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745385:629927][19541:0x7ff382975c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:09:45.629+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:09:45.640+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3818a5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF381884000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04CF9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF38255C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF382358000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF38205E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF381E49000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF381C2C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF381884000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF382765000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3818a5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:09:45.640+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:10:45.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=19755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:10:45.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:10:45.832+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:10:46.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745446:129433][19755:0x7f3d9cda5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:10:46.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:10:46.140+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d9bcd5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D9BCB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF47292000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D9C98C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D9C788000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D9C48E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D9C279000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D9C05C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D9BCB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D9CB95000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d9bcd5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:10:46.140+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:11:45.552+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] MongoDB starting : pid=19967 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:11:45.561+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:11:45.611+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:11:45.954+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745505:954650][19967:0x7fa532b93c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:11:45.954+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:11:45.965+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa531ac3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA531AA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CDF9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA53277A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA532576000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA53227C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA532067000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA531E4A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA531AA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA532983000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa531ac3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:11:45.965+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:12:45.079+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] MongoDB starting : pid=20272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:12:45.086+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:12:45.137+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:12:45.470+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745565:470310][20272:0x7f1754146c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:12:45.470+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:12:45.481+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1753076635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1753055000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA42BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1753D2D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1753B29000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F175382F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F175361A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17533FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1753055000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1753F36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1753076635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:12:45.481+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:13:45.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=20435 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:13:45.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:13:45.666+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:13:45.945+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745625:945817][20435:0x7f9a24e32c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:13:45.945+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:13:45.956+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a23d62635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A23D41000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A24A19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A24815000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A2451B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A24306000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A240E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A23D41000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A24C22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a23d62635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:13:45.956+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:14:45.770+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] MongoDB starting : pid=20715 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:14:45.777+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:14:45.827+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:14:46.078+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745686:78555][20715:0x7fc6dc4e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:14:46.078+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:14:46.089+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6db417635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6DB3F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80CBC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6DC0CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6DBECA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6DBBD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6DB9BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC6DB79E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6DB3F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC6DC2D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6db417635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:14:46.089+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:15:45.215+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] MongoDB starting : pid=20979 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:15:45.223+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:15:45.273+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:15:45.544+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745745:544454][20979:0x7f012b24fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:15:45.544+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:15:45.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f012a17f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F012A15E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F012AE36000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F012AC32000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F012A938000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F012A723000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F012A506000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F012A15E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F012B03F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f012a17f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:15:45.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:16:45.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] MongoDB starting : pid=21198 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:16:45.941+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:16:45.990+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:16:46.279+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745806:279175][21198:0x7f4ebd6e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:16:46.279+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:16:46.290+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ebc618635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4EBC5F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E4DE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4EBD2CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4EBD0CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4EBCDD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4EBCBBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4EBC99F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4EBC5F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4EBD4D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ebc618635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:16:46.290+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:17:45.426+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=21416 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:17:45.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:17:45.486+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:17:45.780+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745865:780071][21416:0x7f7f07666c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:17:45.780+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:17:45.790+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f06596635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F06575000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93C7D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F0724D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F07049000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F06D4F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F06B3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F0691D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F06575000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F07456000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f06596635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:17:45.790+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:18:45.924+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] MongoDB starting : pid=21569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:18:45.932+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:18:45.982+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:18:46.253+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745926:253581][21569:0x7f2e9ac9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:18:46.253+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:18:46.264+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e99bcc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E99BAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5A6E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E9A883000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E9A67F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E9A385000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E9A170000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E99F53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E99BAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E9AA8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e99bcc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:18:46.264+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:19:45.968+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] MongoDB starting : pid=21788 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:19:45.976+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:19:46.027+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:19:46.352+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507745986:352277][21788:0x7f2083625c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:19:46.352+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:19:46.363+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2082555635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2082534000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0C04E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F208320C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2083008000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2082D0E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2082AF9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F20828DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2082534000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2083415000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2082555635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:19:46.363+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:20:45.494+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] MongoDB starting : pid=21942 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:20:45.501+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:20:45.551+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:20:45.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746045:828403][21942:0x7f9a5e6b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:20:45.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:20:45.838+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a5d5e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A5D5C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF54FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A5E29A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A5E096000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A5DD9C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A5DB87000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A5D96A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A5D5C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A5E4A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a5d5e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:20:45.838+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:21:45.215+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] MongoDB starting : pid=22150 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:21:45.224+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:21:45.274+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:21:45.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746105:608179][22150:0x7fd43b7abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:21:45.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:21:45.619+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd43a6db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD43A6BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF636FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD43B392000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD43B18E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD43AE94000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD43AC7F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD43AA62000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD43A6BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD43B59B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd43a6db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:21:45.619+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:22:45.748+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] MongoDB starting : pid=22372 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:22:45.755+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:22:45.805+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:22:46.078+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746166:78097][22372:0x7ffdcce62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:22:46.078+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:22:46.088+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffdcbd92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFDCBD71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF988FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFDCCA49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFDCC845000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFDCC54B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFDCC336000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFDCC119000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFDCBD71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFDCCC52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffdcbd92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:22:46.088+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:23:45.222+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] MongoDB starting : pid=22606 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:23:45.229+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:23:45.279+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:23:45.558+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746225:558636][22606:0x7fc1733e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:23:45.558+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:23:45.569+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc172319635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1722F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC172FD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC172DCC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC172AD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1728BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC1726A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1722F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1731D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc172319635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:23:45.569+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:24:46.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] MongoDB starting : pid=22722 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:24:46.062+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:24:46.112+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:24:46.417+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746286:417130][22722:0x7f927a5fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:24:46.417+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:24:46.428+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f927952c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F927950B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F927A1E3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9279FDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9279CE5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9279AD0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F92798B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F927950B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F927A3EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f927952c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:24:46.428+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:25:46.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] MongoDB starting : pid=22985 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:25:46.566+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:25:46.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:25:46.950+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746346:950615][22985:0x7f6f43d0bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:25:46.950+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:25:46.961+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f42c3b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F42C1A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF514FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F438F2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F436EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F433F4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F431DF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F42FC2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F42C1A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F43AFB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f42c3b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:25:46.961+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:26:46.354+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] MongoDB starting : pid=23187 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:26:46.362+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:26:46.411+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:26:46.786+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746406:786535][23187:0x7fb495bd3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:26:46.786+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:26:46.809+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb494b03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB494AE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8E45000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB4957BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB4955B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB4952BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB4950A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB494E8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB494AE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB4959C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb494b03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:26:46.809+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:27:46.940+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] MongoDB starting : pid=23410 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:27:46.948+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:27:46.997+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:27:47.293+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746467:293385][23410:0x7f8f0b099c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:27:47.293+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:27:47.303+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f09fc9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F09FA8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F0AC80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F0AA7C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F0A782000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F0A56D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F0A350000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F09FA8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F0AE89000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f09fc9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:27:47.303+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:28:46.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] MongoDB starting : pid=23660 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:28:46.438+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:28:46.488+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:28:46.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746526:787581][23660:0x7f2d35c77c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:28:46.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:28:46.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d34ba7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D34B86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF616FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D3585E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D3565A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D35360000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D3514B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D34F2E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D34B86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D35A67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d34ba7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:28:46.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:29:46.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:29:46.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=23777 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:29:46.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:29:46.409+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:29:46.779+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746586:779105][23777:0x7fdf7307dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:29:46.779+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:29:46.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf71fad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF71F8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF72C64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF72A60000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF72766000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF72551000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF72334000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF71F8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF72E6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf71fad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:29:46.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:30:46.931+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:30:46.938+0000 I CONTROL [initandlisten] MongoDB starting : pid=24057 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:30:46.938+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:30:46.939+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:30:46.989+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:30:47.297+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746647:297917][24057:0x7fbb99c22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:30:47.298+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:30:47.308+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb98b52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB98B31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7943B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB99809000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB99605000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB9930B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB990F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB98ED9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB98B31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB99A12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb98b52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:30:47.308+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:31:46.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] MongoDB starting : pid=24258 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:31:46.706+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:31:46.707+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:31:46.756+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:31:47.124+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746707:124358][24258:0x7f7fdcb15c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:31:47.124+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:31:47.144+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7fdba45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7FDBA24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5241000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7FDC6FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7FDC4F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7FDC1FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7FDBFE9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7FDBDCC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7FDBA24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7FDC905000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7fdba45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:31:47.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:32:46.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] MongoDB starting : pid=24481 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:32:46.282+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:32:46.331+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:32:46.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746766:662363][24481:0x7f046401ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:32:46.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:32:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0462f4a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0462F29000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0463C01000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04639FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0463703000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04634EE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04632D1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0462F29000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0463E0A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0462f4a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:32:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:33:46.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=24717 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:33:46.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:33:46.859+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:33:47.239+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746827:239204][24717:0x7f57e0797c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:33:47.239+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:33:47.249+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f57df6c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F57DF6A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFACE89000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F57E037E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F57E017A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F57DFE80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F57DFC6B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F57DFA4E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F57DF6A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F57E0587000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f57df6c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:33:47.249+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:34:46.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] MongoDB starting : pid=24842 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:34:46.797+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:34:46.847+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:34:47.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746887:209748][24842:0x7f2f72c66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:34:47.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:34:47.230+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f71b96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F71B75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F7284D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F72649000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F7234F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F7213A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F71F1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F71B75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F72A56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f71b96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:34:47.230+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:35:46.352+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] MongoDB starting : pid=25101 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:35:46.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:35:46.410+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:35:46.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507746946:702903][25101:0x7f44972bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:35:46.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:35:46.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44961ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44961C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C0B8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4496EA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4496C9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44969A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F449678E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4496571000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44961C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44970AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44961ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:35:46.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:36:46.103+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] MongoDB starting : pid=25310 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:36:46.112+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:36:46.164+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:36:46.515+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747006:515118][25310:0x7f081d4ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:36:46.515+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:36:46.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f081c41b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F081C3FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF606FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F081D0D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F081CECE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F081CBD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F081C9BF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F081C7A2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F081C3FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F081D2DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f081c41b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:36:46.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:37:46.654+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] MongoDB starting : pid=25532 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:37:46.662+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:37:46.712+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:37:47.010+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747067:10029][25532:0x7f254bb6fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:37:47.010+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:37:47.020+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f254aa9f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F254AA7E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE23ED000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F254B756000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F254B552000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F254B258000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F254B043000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F254AE26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F254AA7E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F254B95F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f254aa9f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:37:47.020+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:38:46.150+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] MongoDB starting : pid=25770 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:38:46.157+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:38:46.207+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:38:46.505+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747126:505838][25770:0x7fee6c0f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:38:46.505+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:38:46.516+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee6b026635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE6B005000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE6BCDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE6BAD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE6B7DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE6B5CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE6B3AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE6B005000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE6BEE6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee6b026635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:38:46.516+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:39:46.150+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] MongoDB starting : pid=25894 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:39:46.157+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:39:46.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:39:46.549+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747186:549750][25894:0x7f55c19b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:39:46.549+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:39:46.562+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55c08e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F55C08C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F55C15A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F55C139C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F55C10A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F55C0E8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F55C0C70000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F55C08C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F55C17A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55c08e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:39:46.562+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:40:46.690+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] MongoDB starting : pid=26165 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:40:46.698+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:40:46.760+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:40:47.108+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747247:108260][26165:0x7f2f0146ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:40:47.108+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:40:47.118+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f0039e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F0037D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA68FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F01055000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F00E51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F00B57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F00942000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F00725000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F0037D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F0125E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f0039e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:40:47.118+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:41:46.547+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] MongoDB starting : pid=26374 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:41:46.555+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:41:46.605+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:41:46.936+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747306:935992][26374:0x7f6f74fbdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:41:46.936+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:41:46.955+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f73eed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F73ECC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB37D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F74BA4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F749A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F746A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F74491000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F74274000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F73ECC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F74DAD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f73eed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:41:46.955+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:42:46.092+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] MongoDB starting : pid=26615 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:42:46.103+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:42:46.162+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:42:46.450+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747366:450011][26615:0x7f2ffd945c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:42:46.450+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:42:46.460+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ffc875635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FFC854000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FFD52C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FFD328000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FFD02E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FFCE19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FFCBFC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FFC854000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FFD735000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ffc875635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:42:46.460+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:43:46.590+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=26857 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:43:46.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:43:46.599+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:43:46.649+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:43:46.955+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747426:955714][26857:0x7ff6edf5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:43:46.955+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:43:46.966+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff6ece8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF6ECE6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF6EDB46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF6ED942000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF6ED648000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF6ED433000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF6ED216000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF6ECE6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF6EDD4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff6ece8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:43:46.966+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:44:46.269+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] MongoDB starting : pid=26976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:44:46.273+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:44:46.307+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:44:46.604+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747486:604028][26976:0x7f3e4cd7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:44:46.604+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:44:46.614+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e4bcad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E4BC8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF226FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E4C964000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E4C760000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E4C466000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E4C251000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E4C034000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E4BC8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E4CB6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e4bcad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:44:46.614+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:45:46.734+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] MongoDB starting : pid=27241 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:45:46.741+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:45:46.791+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:45:47.097+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747547:97840][27241:0x7f41fc2cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:45:47.097+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:45:47.108+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41fb1ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41FB1DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF252FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F41FBEB6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F41FBCB2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41FB9B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F41FB7A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F41FB586000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41FB1DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41FC0BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41fb1ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:45:47.108+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:46:46.480+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=27445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:46:46.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:46:46.488+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:46:46.537+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:46:46.816+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747606:816570][27445:0x7fe48f8dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:46:46.816+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:46:46.828+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe48e80b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE48E7EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F273000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE48F4C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE48F2BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE48EFC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE48EDAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE48EB92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE48E7EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE48F6CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe48e80b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:46:46.828+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:47:46.950+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=27665 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:47:46.958+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:47:47.007+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:47:47.403+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747667:403179][27665:0x7f1069df7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:47:47.403+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:47:47.423+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1068d27635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1068D06000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3DEC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10699DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10697DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10694E0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10692CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10690AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1068D06000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1069BE7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1068d27635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:47:47.423+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:48:46.555+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] MongoDB starting : pid=27894 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:48:46.563+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:48:46.613+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:48:46.965+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747726:965580][27894:0x7ffe8da3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:48:46.965+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:48:46.976+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe8c96b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE8C94A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C480000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE8D622000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE8D41E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE8D124000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE8CF0F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE8CCF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE8C94A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE8D82B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe8c96b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:48:46.976+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:49:46.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=28026 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:49:46.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:49:46.900+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:49:47.200+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747787:200480][28026:0x7f95025c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:49:47.200+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:49:47.211+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f95014f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F95014D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF50CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F95021AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9501FA6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9501CAC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9501A97000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F950187A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F95014D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F95023B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f95014f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:49:47.211+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:50:46.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] MongoDB starting : pid=28293 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:50:46.345+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:50:46.394+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:50:46.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747846:670786][28293:0x7fa8c97e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:50:46.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:50:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8c8712635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8C86F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF656CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8C93C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8C91C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8C8ECB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8C8CB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8C8A99000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8C86F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8C95D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8c8712635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:50:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:51:46.100+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] MongoDB starting : pid=28494 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:51:46.108+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:51:46.161+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:51:46.471+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747906:471502][28494:0x7f4b25b3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:51:46.471+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:51:46.482+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b24a6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B24A49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF570FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B25721000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B2551D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B25223000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B2500E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B24DF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B24A49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B2592A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b24a6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:51:46.482+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:52:46.611+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] MongoDB starting : pid=28728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:52:46.619+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:52:46.670+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:52:47.067+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507747967:67130][28728:0x7fd2506e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:52:47.067+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:52:47.086+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd24f612635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD24F5F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF438A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2502C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2500C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD24FDCB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD24FBB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD24F999000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD24F5F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2504D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd24f612635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:52:47.086+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:53:46.206+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] MongoDB starting : pid=28946 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:53:46.214+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:53:46.265+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:53:46.629+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748026:629478][28946:0x7fcd72d4cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:53:46.629+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:53:46.640+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd71c7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD71C5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD72933000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD7272F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD72435000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD72220000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD72003000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD71C5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD72B3C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd71c7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:53:46.640+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:54:47.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=29077 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:54:47.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:54:47.100+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:54:47.456+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748087:456513][29077:0x7f2f61650c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:54:47.456+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:54:47.476+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f60580635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F6055F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F61237000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F61033000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F60D39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F60B24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F60907000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F6055F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F61440000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f60580635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:54:47.476+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:55:46.598+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] MongoDB starting : pid=29317 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:55:46.606+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:55:46.655+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:55:47.011+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748147:11677][29317:0x7ff57b40cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:55:47.011+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:55:47.022+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff57a33c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF57A31B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF087000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF57AFF3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF57ADEF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF57AAF5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF57A8E0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF57A6C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF57A31B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF57B1FC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff57a33c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:55:47.022+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:56:46.403+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] MongoDB starting : pid=29455 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:56:46.410+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:56:46.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:56:46.736+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748206:736687][29455:0x7f871feefc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:56:46.736+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:56:46.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f871ee1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F871EDFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F871FAD6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F871F8D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F871F5D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F871F3C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F871F1A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F871EDFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F871FCDF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f871ee1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:56:46.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:57:46.882+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] MongoDB starting : pid=29675 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:57:46.889+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:57:46.940+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:57:47.215+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748267:215594][29675:0x7fe9295b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:57:47.215+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:57:47.226+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe9284e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE9284C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF32FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE92919C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE928F98000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE928C9E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE928A89000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE92886C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE9284C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE9293A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe9284e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:57:47.226+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:58:46.376+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] MongoDB starting : pid=29912 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:58:46.383+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:58:46.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:58:46.735+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748326:735726][29912:0x7f0d10941c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:58:46.735+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:58:46.748+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d0f871635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D0F850000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D10528000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D10324000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D1002A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D0FE15000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D0FBF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D0F850000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D10731000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d0f871635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:58:46.748+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T18:59:46.235+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T18:59:46.243+0000 I CONTROL [initandlisten] MongoDB starting : pid=30131 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T18:59:46.243+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T18:59:46.243+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T18:59:46.244+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T18:59:46.244+0000 I CONTROL [initandlisten] modules: none 2017-10-11T18:59:46.244+0000 I CONTROL [initandlisten] build environment: 2017-10-11T18:59:46.244+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T18:59:46.244+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T18:59:46.244+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T18:59:46.294+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T18:59:46.585+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748386:585008][30131:0x7fd55af17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T18:59:46.585+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T18:59:46.595+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd559e47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD559E26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD55AAFE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD55A8FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD55A600000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD55A3EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD55A1CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD559E26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD55AD07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd559e47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T18:59:46.595+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:00:46.720+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] MongoDB starting : pid=30268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:00:46.727+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:00:46.779+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:00:47.113+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748447:113601][30268:0x7f55a0519c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:00:47.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:00:47.124+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f559f449635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F559F428000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F55A0100000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F559FEFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F559FC02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F559F9ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F559F7D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F559F428000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F55A0309000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f559f449635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:00:47.124+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:01:46.576+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] MongoDB starting : pid=30523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:01:46.583+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:01:46.633+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:01:46.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748506:963575][30523:0x7f3996dd3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:01:46.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:01:46.974+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3995d03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3995CE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F45E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39969BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39967B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39964BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39962A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F399608A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3995CE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3996BC3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3995d03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:01:46.974+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:02:46.661+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] MongoDB starting : pid=30740 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:02:46.668+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:02:46.717+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:02:47.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748567:92031][30740:0x7f66edc03c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:02:47.092+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:02:47.111+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f66ecb33635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F66ECB12000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26229000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F66ED7EA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F66ED5E6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F66ED2EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F66ED0D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F66ECEBA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F66ECB12000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F66ED9F3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f66ecb33635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:02:47.111+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:03:46.240+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] MongoDB starting : pid=30963 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:03:46.248+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:03:46.298+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:03:46.609+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748626:609280][30963:0x7f7152163c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:03:46.609+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:03:46.621+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7151093635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7151072000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C837000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7151D4A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7151B46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F715184C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7151637000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F715141A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7151072000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7151F53000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7151093635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:03:46.621+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:04:46.625+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] MongoDB starting : pid=31194 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:04:46.631+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:04:46.668+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:04:47.057+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748687:57093][31194:0x7f3be797bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:04:47.057+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:04:47.077+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3be68ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3BE688A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF44AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BE7562000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BE735E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BE7064000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BE6E4F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BE6C32000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BE688A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BE776B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3be68ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:04:47.077+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:05:46.208+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] MongoDB starting : pid=31314 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:05:46.215+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:05:46.265+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:05:46.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748746:511489][31314:0x7fd0093c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:05:46.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:05:46.522+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0082f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0082D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C25F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD008FAD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD008DA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD008AAF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD00889A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD00867D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0082D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0091B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0082f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:05:46.522+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:06:46.967+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] MongoDB starting : pid=31582 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:06:46.975+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:06:47.025+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:06:47.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748807:338957][31582:0x7f7a21cfdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:06:47.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:06:47.349+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a20c2d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A20C0C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF438A1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A218E4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A216E0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A213E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A211D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A20FB4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A20C0C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A21AED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a20c2d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:06:47.349+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:07:46.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=31787 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:07:46.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:07:46.540+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:07:46.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748866:837963][31787:0x7fce97813c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:07:46.838+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:07:46.849+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce96743635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE96722000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF928FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE973FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE971F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE96EFC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE96CE7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE96ACA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE96722000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE97603000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce96743635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:07:46.849+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:08:46.984+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] MongoDB starting : pid=32025 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:08:46.993+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:08:47.042+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:08:47.405+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748927:405785][32025:0x7f7c1ad38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:08:47.405+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:08:47.425+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c19c68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C19C47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC35CA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C1A91F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C1A71B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C1A421000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C1A20C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C19FEF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C19C47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C1AB28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c19c68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:08:47.425+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:09:46.546+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] MongoDB starting : pid=32254 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:09:46.553+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:09:46.554+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:09:46.605+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:09:46.889+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507748986:889026][32254:0x7f5e8b3e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:09:46.889+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:09:46.899+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e8a318635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E8A2F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBEE3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E8AFCF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E8ADCB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E8AAD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E8A8BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E8A69F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E8A2F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E8B1D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e8a318635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:09:46.899+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:10:46.910+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:10:46.916+0000 I CONTROL [initandlisten] MongoDB starting : pid=32371 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:10:46.917+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:10:46.967+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:10:47.300+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749047:300222][32371:0x7f703842dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:10:47.300+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:10:47.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f703735d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F703733C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF286EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7038014000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7037E10000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7037B16000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7037901000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F70376E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F703733C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F703821D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f703735d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:10:47.319+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:11:46.786+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] MongoDB starting : pid=32644 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:11:46.793+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:11:46.842+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:11:47.241+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749107:241528][32644:0x7ffbc70f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:11:47.241+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:11:47.261+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffbc6026635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBC6005000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF520FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBC6CDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBC6AD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBC67DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBC65CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBC63AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBC6005000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBC6EE6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffbc6026635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:11:47.261+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:12:46.384+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:12:46.392+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:12:46.444+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:12:46.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749166:841225][388:0x7faed8a5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:12:46.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:12:46.860+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faed798f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAED796E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAED8646000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAED8442000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAED8148000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAED7F33000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAED7D16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAED796E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAED884F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faed798f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:12:46.860+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:13:46.999+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] MongoDB starting : pid=625 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:13:47.006+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:13:47.058+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:13:47.432+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749227:432535][625:0x7f37fbbc0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:13:47.432+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:13:47.452+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37faaf0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37FAACF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF760FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37FB7A7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37FB5A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F37FB2A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37FB094000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F37FAE77000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37FAACF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F37FB9B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37faaf0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:13:47.453+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:14:46.578+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:14:46.585+0000 I CONTROL [initandlisten] MongoDB starting : pid=860 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:14:46.586+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:14:46.635+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:14:47.001+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749287:1294][860:0x7fe2e3732c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:14:47.001+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:14:47.011+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2e2662635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2E2641000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA286000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2E3319000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2E3115000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2E2E1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2E2C06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2E29E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2E2641000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2E3522000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2e2662635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:14:47.012+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:15:46.977+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] MongoDB starting : pid=984 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:15:46.984+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:15:47.036+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:15:47.372+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749347:372173][984:0x7f64b07ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:15:47.372+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:15:47.384+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f64af72f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F64AF70E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D17B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F64B03E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F64B01E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F64AFEE8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F64AFCD3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F64AFAB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F64AF70E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F64B05EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f64af72f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:15:47.385+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:16:46.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] MongoDB starting : pid=1253 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:16:46.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:16:46.850+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:16:47.205+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749407:205111][1253:0x7f72490e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:16:47.205+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:16:47.215+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7248012635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7247FF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA47AA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7248CC9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7248AC5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F72487CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F72485B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7248399000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7247FF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7248ED2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7248012635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:16:47.216+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:17:46.344+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=1454 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:17:46.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:17:46.403+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:17:46.822+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749466:822590][1454:0x7fc587d28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:17:46.822+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:17:46.846+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc586c58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC586C37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE02FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC58790F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC58770B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC587411000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC5871FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC586FDF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC586C37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC587B18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc586c58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:17:46.846+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:18:46.972+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=1682 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:18:46.979+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:18:47.031+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:18:47.346+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749527:346966][1682:0x7ff3a39f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:18:47.347+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:18:47.358+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3a2924635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3A2903000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F998000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3A35DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3A33D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3A30DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3A2EC8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3A2CAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3A2903000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3A37E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3a2924635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:18:47.358+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:19:46.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=1915 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:19:46.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:19:46.549+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:19:46.851+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749586:851698][1915:0x7f1c00ed0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:19:46.851+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:19:46.871+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1bffe00635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1BFFDDF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C00AB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C008B3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C005B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C003A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C00187000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1BFFDDF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C00CC0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1bffe00635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:19:46.871+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:20:46.281+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] MongoDB starting : pid=2029 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:20:46.288+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:20:46.337+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:20:46.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749646:674913][2029:0x7f1c4b59ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:20:46.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:20:46.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c4a4ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C4A4A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB432000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C4B181000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C4AF7D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C4AC83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C4AA6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C4A851000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C4A4A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C4B38A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c4a4ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:20:46.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:21:46.062+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] MongoDB starting : pid=2308 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:21:46.069+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:21:46.118+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:21:46.522+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749706:522961][2308:0x7fd48fe10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:21:46.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:21:46.542+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd48ed40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD48ED1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE48FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD48F9F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD48F7F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD48F4F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD48F2E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD48F0C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD48ED1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD48FC00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd48ed40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:21:46.542+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:22:46.666+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=2515 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:22:46.674+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:22:46.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:22:47.138+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749767:138915][2515:0x7f523f0a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:22:47.139+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:22:47.158+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f523dfd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F523DFB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF258FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F523EC88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F523EA84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F523E78A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F523E575000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F523E358000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F523DFB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F523EE91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f523dfd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:22:47.158+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:23:46.282+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] MongoDB starting : pid=2743 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:23:46.289+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:23:46.338+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:23:46.637+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749826:637219][2743:0x7f3d16744c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:23:46.637+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:23:46.656+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d15674635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D15653000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF718FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D1632B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D16127000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D15E2D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D15C18000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D159FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D15653000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D16534000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d15674635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:23:46.656+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:24:46.792+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] MongoDB starting : pid=2976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:24:46.800+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:24:46.855+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:24:47.292+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749887:292634][2976:0x7f71bbd94c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:24:47.292+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:24:47.312+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f71bacc4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F71BACA3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0EE47000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F71BB97B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71BB777000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71BB47D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71BB268000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71BB04B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F71BACA3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F71BBB84000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f71bacc4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:24:47.312+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:25:46.597+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] MongoDB starting : pid=3093 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:25:46.608+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:25:46.666+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:25:46.949+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507749946:949537][3093:0x7f7d28945c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:25:46.949+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:25:46.961+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d27875635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D27854000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF398FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D2852C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D28328000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D2802E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D27E19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D27BFC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D27854000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D28735000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d27875635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:25:46.961+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:26:46.446+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] MongoDB starting : pid=3363 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:26:46.454+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:26:46.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:26:46.865+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750006:865301][3363:0x7f5e6d592c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:26:46.865+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:26:46.877+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e6c4c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E6C4A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E6D179000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E6CF75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E6CC7B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E6CA66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E6C849000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E6C4A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E6D382000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e6c4c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:26:46.877+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:27:47.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] MongoDB starting : pid=3576 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:27:47.010+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:27:47.060+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:27:47.397+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750067:397611][3576:0x7f2f315e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:27:47.397+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:27:47.408+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f30513635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F304F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA82C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F311CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F30FC6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F30CCC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F30AB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F3089A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F304F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F313D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f30513635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:27:47.408+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:28:46.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] MongoDB starting : pid=3822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:28:46.550+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:28:46.608+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:28:46.978+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750126:978558][3822:0x7f64909ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:28:46.978+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:28:46.998+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f648f90d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F648F8EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8456000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F64905C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F64903C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F64900C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F648FEB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F648FC94000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F648F8EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F64907CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f648f90d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:28:46.998+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:29:46.127+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] MongoDB starting : pid=4049 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:29:46.135+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:29:46.185+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:29:46.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750186:556546][4049:0x7f061f4cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:29:46.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:29:46.567+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f061e3fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F061E3DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF322EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F061F0B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F061EEB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F061EBB7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F061E9A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F061E785000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F061E3DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F061F2BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f061e3fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:29:46.567+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:30:46.310+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:30:46.317+0000 I CONTROL [initandlisten] MongoDB starting : pid=4164 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:30:46.318+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:30:46.369+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:30:46.701+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750246:701389][4164:0x7f63e71a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:30:46.701+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:30:46.712+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63e60d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63E60B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E6AC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63E6D8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63E6B8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F63E6891000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63E667C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63E645F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63E60B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F63E6F98000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63e60d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:30:46.712+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:31:46.079+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] MongoDB starting : pid=4364 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:31:46.087+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:31:46.152+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:31:46.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750306:440742][4364:0x7f174b810c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:31:46.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:31:46.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f174a740635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F174A71F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86A3B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F174B3F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F174B1F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F174AEF9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F174ACE4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F174AAC7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F174A71F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F174B600000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f174a740635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:31:46.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:32:46.584+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] MongoDB starting : pid=4548 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:32:46.591+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:32:46.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:32:47.047+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750367:47372][4548:0x7f98e1e7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:32:47.047+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:32:47.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98e0dab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98E0D8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98E1A62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98E185E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98E1564000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98E134F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98E1132000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98E0D8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98E1C6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98e0dab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:32:47.066+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:33:46.205+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] MongoDB starting : pid=4779 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:33:46.213+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:33:46.265+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:33:46.695+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750426:695201][4779:0x7fcc1ddb4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:33:46.695+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:33:46.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcc1cce4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCC1CCC3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCC1D99B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCC1D797000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCC1D49D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCC1D288000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCC1D06B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCC1CCC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCC1DBA4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcc1cce4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:33:46.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:34:46.845+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] MongoDB starting : pid=5196 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:34:46.856+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:34:46.922+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:34:47.263+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750487:263226][5196:0x7f71ec537c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:34:47.263+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:34:47.283+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f71eb467635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F71EB446000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEF010000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F71EC11E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71EBF1A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71EBC20000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71EBA0B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71EB7EE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F71EB446000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F71EC327000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f71eb467635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:34:47.283+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:35:46.616+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] MongoDB starting : pid=5511 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:35:46.624+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:35:46.674+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:35:47.064+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750547:64087][5511:0x7fe2b543fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:35:47.064+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:35:47.088+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2b436f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2B434E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF818FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2B5026000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2B4E22000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2B4B28000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2B4913000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2B46F6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2B434E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2B522F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2b436f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:35:47.088+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:36:46.488+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] MongoDB starting : pid=5694 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:36:46.496+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:36:46.546+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:36:46.891+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750606:891448][5694:0x7fdf47375c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:36:46.891+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:36:46.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf462a5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF46284000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF722BC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF46F5C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF46D58000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF46A5E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF46849000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF4662C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF46284000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF47165000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf462a5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:36:46.904+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:37:47.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=6118 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:37:47.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:37:47.088+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:37:47.394+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750667:394621][6118:0x7f79bc701c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:37:47.394+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:37:47.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f79bb631635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79BB610000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15ACD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79BC2E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79BC0E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79BBDEA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F79BBBD5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79BB9B8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79BB610000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79BC4F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f79bb631635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:37:47.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:38:46.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] MongoDB starting : pid=6488 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:38:46.541+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:38:46.594+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:38:46.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750726:963388][6488:0x7fed6e4ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:38:46.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:38:46.982+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed6d41c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED6D3FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF422FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED6E0D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED6DECF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED6DBD5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED6D9C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED6D7A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED6D3FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED6E2DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed6d41c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:38:46.982+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:39:46.102+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] MongoDB starting : pid=6749 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:39:46.109+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:39:46.161+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:39:46.455+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750786:455811][6749:0x7f492caafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:39:46.455+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:39:46.475+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f492b9df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F492B9BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF32C1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F492C696000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F492C492000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F492C198000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F492BF83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F492BD66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F492B9BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F492C89F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f492b9df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:39:46.475+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:40:46.135+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] MongoDB starting : pid=6951 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:40:46.142+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:40:46.195+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:40:46.557+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750846:557075][6951:0x7feca99d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:40:46.557+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:40:46.576+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feca8901635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECA88E0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECA95B8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECA93B4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECA90BA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECA8EA5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECA8C88000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECA88E0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FECA97C1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feca8901635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:40:46.576+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:41:46.958+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] MongoDB starting : pid=7087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:41:46.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:41:47.015+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:41:47.354+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750907:354365][7087:0x7f46a04a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:41:47.354+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:41:47.364+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f469f3d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F469F3AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF508FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F46A0087000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F469FE83000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F469FB89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F469F974000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F469F757000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F469F3AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F46A0290000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f469f3d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:41:47.365+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:42:46.493+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] MongoDB starting : pid=7361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:42:46.500+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:42:46.550+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:42:46.885+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507750966:885780][7361:0x7fd27b40dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:42:46.885+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:42:46.905+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd27a33d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD27A31C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF09253000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD27AFF4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD27ADF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD27AAF6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD27A8E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD27A6C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD27A31C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD27B1FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd27a33d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:42:46.905+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:43:47.023+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] MongoDB starting : pid=7596 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:43:47.031+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:43:47.082+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:43:47.402+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751027:402260][7596:0x7f908a284c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:43:47.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:43:47.414+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90891b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9089193000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1F0A4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9089E6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9089C67000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F908996D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9089758000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F908953B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9089193000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F908A074000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90891b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:43:47.414+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:44:46.530+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:44:46.537+0000 I CONTROL [initandlisten] MongoDB starting : pid=7833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:44:46.538+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:44:46.600+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:44:46.900+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751086:900977][7833:0x7f6c77973c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:44:46.901+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:44:46.911+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6c768a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6C76882000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF744FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C7755A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C77356000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C7705C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C76E47000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6C76C2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6C76882000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C77763000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6c768a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:44:46.911+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:45:46.344+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=8043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:45:46.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:45:46.402+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:45:46.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751146:787709][8043:0x7fdc97f7ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:45:46.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:45:46.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc96eae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC96E8D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC476D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC97B65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC97961000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC97667000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC97452000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC97235000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC96E8D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC97D6E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc96eae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:45:46.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:46:46.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:46:46.265+0000 I CONTROL [initandlisten] MongoDB starting : pid=8172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:46:46.265+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:46:46.265+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:46:46.265+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:46:46.266+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:46:46.266+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:46:46.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:46:46.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:46:46.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:46:46.317+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:46:46.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751206:661965][8172:0x7fdcb802fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:46:46.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:46:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdcb6f5f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCB6F3E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF326FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCB7C16000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCB7A12000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCB7718000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCB7503000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCB72E6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCB6F3E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCB7E1F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdcb6f5f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:46:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:47:46.807+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:47:46.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=8443 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:47:46.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:47:46.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:47:46.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:47:46.814+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:47:46.815+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:47:46.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:47:46.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:47:46.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:47:46.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:47:47.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751267:276269][8443:0x7f219a387c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:47:47.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:47:47.295+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21992b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2199296000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2199F6E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2199D6A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2199A70000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F219985B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F219963E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2199296000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F219A177000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21992b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:47:47.295+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:48:46.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] MongoDB starting : pid=8699 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:48:46.410+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:48:46.438+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:48:46.679+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751326:679254][8699:0x7fd2dfbe4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:48:46.679+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:48:46.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd2deb14635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD2DEAF3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA78FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2DF7CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2DF5C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2DF2CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD2DF0B8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD2DEE9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD2DEAF3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2DF9D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd2deb14635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:48:46.690+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:49:46.806+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] MongoDB starting : pid=8932 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:49:46.813+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:49:46.863+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:49:47.163+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751387:163171][8932:0x7f35f2839c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:49:47.163+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:49:47.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f35f1769635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F35F1748000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F409000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F35F2420000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F35F221C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35F1F22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F35F1D0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F35F1AF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F35F1748000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F35F2629000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f35f1769635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:49:47.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:50:46.553+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] MongoDB starting : pid=9135 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:50:46.560+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:50:46.609+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:50:46.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751446:894827][9135:0x7faf1d323c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:50:46.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:50:46.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf1c253635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF1C232000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1F414000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF1CF0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF1CD06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF1CA0C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF1C7F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF1C5DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF1C232000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF1D113000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf1c253635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:50:46.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:51:46.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] MongoDB starting : pid=9264 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:51:46.389+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:51:46.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:51:46.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751506:784545][9264:0x7f0e18ce5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:51:46.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:51:46.796+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e17c15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E17BF4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB5237000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E188CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E186C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E183CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E181B9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E17F9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E17BF4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E18AD5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e17c15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:51:46.796+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:52:46.917+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] MongoDB starting : pid=9519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:52:46.926+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:52:46.975+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:52:47.284+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751567:284418][9519:0x7f645b50ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:52:47.284+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:52:47.295+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f645a43e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F645A41D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF098FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F645B0F5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F645AEF1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F645ABF7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F645A9E2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F645A7C5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F645A41D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F645B2FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f645a43e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:52:47.295+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:53:46.415+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] MongoDB starting : pid=9745 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:53:46.423+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:53:46.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:53:46.722+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751626:722696][9745:0x7f41179b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:53:46.722+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:53:46.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41168e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41168C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8AC8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F411759C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4117398000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F411709E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4116E89000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4116C6C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41168C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41177A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41168e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:53:46.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:54:46.859+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] MongoDB starting : pid=9976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:54:46.867+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:54:46.916+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:54:47.246+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751687:246234][9976:0x7f8a3e450c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:54:47.246+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:54:47.256+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8a3d380635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8A3D35F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8A3E037000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8A3DE33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8A3DB39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8A3D924000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8A3D707000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8A3D35F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8A3E240000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8a3d380635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:54:47.256+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:55:46.674+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] MongoDB starting : pid=10179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:55:46.682+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:55:46.738+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:55:47.076+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751747:76405][10179:0x7fabe4d83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:55:47.076+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:55:47.090+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabe3cb3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABE3C92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABE496A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABE4766000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABE446C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABE4257000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABE403A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABE3C92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABE4B73000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabe3cb3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:55:47.090+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:56:46.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=10309 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:56:46.565+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:56:46.618+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:56:46.919+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751806:919740][10309:0x7f7d04719c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:56:46.919+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:56:46.930+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d03649635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D03628000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF638FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D04300000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D040FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D03E02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D03BED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D039D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D03628000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D04509000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d03649635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:56:46.930+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:57:46.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] MongoDB starting : pid=10566 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:57:46.053+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:57:46.103+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:57:46.406+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751866:406825][10566:0x7fdfdea31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:57:46.406+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:57:46.418+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdfdd961635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFDD940000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3EC4D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFDE618000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFDE414000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFDE11A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFDDF05000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFDDCE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFDD940000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFDE821000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdfdd961635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:57:46.418+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:58:46.544+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] MongoDB starting : pid=10803 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:58:46.552+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:58:46.603+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:58:46.979+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751926:979889][10803:0x7fe5ac343c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:58:46.979+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:58:46.999+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe5ab273635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5AB252000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0802B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE5ABF2A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE5ABD26000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE5ABA2C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE5AB817000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE5AB5FA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5AB252000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE5AC133000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe5ab273635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:58:46.999+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T19:59:46.134+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] MongoDB starting : pid=11040 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] modules: none 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] build environment: 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T19:59:46.141+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T19:59:46.193+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T19:59:46.516+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507751986:516122][11040:0x7fbb030f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T19:59:46.516+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T19:59:46.526+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb02029635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB02008000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF148E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB02CE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB02ADC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB027E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB025CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB023B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB02008000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB02EE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb02029635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T19:59:46.527+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:00:46.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=11251 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:00:46.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:00:46.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:00:47.191+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752047:191165][11251:0x7f4d64cadc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:00:47.191+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:00:47.210+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d63bdd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D63BBC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FA44000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D64894000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D64690000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D64396000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D64181000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D63F64000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D63BBC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D64A9D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d63bdd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:00:47.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:01:46.590+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:01:46.597+0000 I CONTROL [initandlisten] MongoDB starting : pid=11382 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:01:46.597+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:01:46.597+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:01:46.597+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:01:46.597+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:01:46.598+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:01:46.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:01:46.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:01:46.598+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:01:46.647+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:01:47.049+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752107:49225][11382:0x7ff512d3fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:01:47.049+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:01:47.069+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff511c6f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF511C4E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10ECE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF512926000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF512722000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF512428000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF512213000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF511FF6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF511C4E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF512B2F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff511c6f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:01:47.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:02:46.593+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=11641 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:02:46.601+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:02:46.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:02:47.069+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752167:69519][11641:0x7ffbebfd9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:02:47.069+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:02:47.088+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffbeaf09635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBEAEE8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6786000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBEBBC0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBEB9BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBEB6C2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBEB4AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBEB290000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBEAEE8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBEBDC9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffbeaf09635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:02:47.088+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:03:46.213+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] MongoDB starting : pid=11871 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:03:46.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:03:46.270+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:03:46.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752226:674954][11871:0x7f51aaf47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:03:46.675+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:03:46.696+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51a9e77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51A9E56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB2A63000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51AAB2E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51AA92A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51AA630000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51AA41B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51AA1FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51A9E56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51AAD37000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51a9e77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:03:46.696+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:04:46.842+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=12111 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:04:46.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:04:46.899+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:04:47.308+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752287:308707][12111:0x7fba6ec96c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:04:47.308+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:04:47.328+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba6dbc6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA6DBA5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA6E87D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA6E679000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA6E37F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA6E16A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA6DF4D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA6DBA5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA6EA86000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba6dbc6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:04:47.328+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:05:46.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=12316 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:05:46.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:05:46.201+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:05:46.543+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752346:543083][12316:0x7f3a0e129c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:05:46.543+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:05:46.555+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3a0d059635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3A0D038000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2820B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3A0DD10000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3A0DB0C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3A0D812000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3A0D5FD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3A0D3E0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3A0D038000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3A0DF19000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3a0d059635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:05:46.555+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:06:46.968+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] MongoDB starting : pid=12457 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:06:46.976+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:06:47.026+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:06:47.414+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752407:414341][12457:0x7f238fd3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:06:47.414+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:06:47.434+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f238ec6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F238EC49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF752FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F238F921000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F238F71D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F238F423000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F238F20E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F238EFF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F238EC49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F238FB2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f238ec6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:06:47.434+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:07:46.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] MongoDB starting : pid=12663 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:07:46.582+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:07:46.637+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:07:47.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752467:19582][12663:0x7fcee7c7ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:07:47.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:07:47.039+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcee6baa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCEE6B89000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCEE7861000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCEE765D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCEE7363000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCEE714E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCEE6F31000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCEE6B89000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCEE7A6A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcee6baa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:07:47.039+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:08:46.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=12864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:08:46.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:08:46.224+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:08:46.501+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752526:501682][12864:0x7f8141215c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:08:46.501+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:08:46.522+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8140145635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8140124000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF2CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8140DFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8140BF8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F81408FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81406E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F81404CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8140124000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8141005000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8140145635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:08:46.522+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:09:46.651+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] MongoDB starting : pid=13094 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:09:46.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:09:46.708+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:09:47.032+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752587:32732][13094:0x7f2864138c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:09:47.032+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:09:47.043+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2863068635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2863047000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF718FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2863D1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2863B1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2863821000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F286360C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28633EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2863047000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2863F28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2863068635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:09:47.043+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:10:46.515+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] MongoDB starting : pid=13295 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:10:46.523+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:10:46.524+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:10:46.524+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:10:46.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:10:46.959+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752646:959400][13295:0x7fbcf1a01c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:10:46.959+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:10:46.979+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbcf0931635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBCF0910000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97D5D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBCF15E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBCF13E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBCF10EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBCF0ED5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBCF0CB8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBCF0910000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBCF17F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbcf0931635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:10:46.979+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:11:46.467+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:11:46.479+0000 I CONTROL [initandlisten] MongoDB starting : pid=13513 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:11:46.479+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:11:46.479+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:11:46.479+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:11:46.480+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:11:46.480+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:11:46.480+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:11:46.480+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:11:46.480+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:11:46.535+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:11:46.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752706:915236][13513:0x7f63a7f7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:11:46.915+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:11:46.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63a6ead635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63A6E8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5F22000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63A7B64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63A7960000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F63A7666000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63A7451000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63A7234000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63A6E8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F63A7D6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63a6ead635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:11:46.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:12:46.056+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] MongoDB starting : pid=13697 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:12:46.064+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:12:46.113+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:12:46.484+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752766:484207][13697:0x7fdbde9c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:12:46.484+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:12:46.505+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdbdd8f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDBDD8D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDBDE5AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDBDE3AA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDBDE0B0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDBDDE9B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDBDDC7E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDBDD8D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDBDE7B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdbdd8f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:12:46.505+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:13:46.635+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:13:46.642+0000 I CONTROL [initandlisten] MongoDB starting : pid=14047 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:13:46.643+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:13:46.700+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:13:47.093+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752827:93155][14047:0x7f199fd3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:13:47.093+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:13:47.112+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f199ec6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F199EC4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F0D3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F199F923000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F199F71F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F199F425000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F199F210000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F199EFF3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F199EC4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F199FB2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f199ec6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:13:47.112+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:14:46.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] MongoDB starting : pid=14272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:14:46.245+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:14:46.294+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:14:46.609+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752886:609819][14272:0x7f172e3b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:14:46.609+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:14:46.620+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f172d2e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F172D2BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F1F0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F172DF97000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F172DD93000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F172DA99000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F172D884000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F172D667000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F172D2BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F172E1A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f172d2e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:14:46.620+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:15:46.694+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:15:46.705+0000 I CONTROL [initandlisten] MongoDB starting : pid=14744 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:15:46.705+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:15:46.706+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:15:46.759+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:15:47.075+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507752947:75956][14744:0x7ff23aeafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:15:47.076+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:15:47.087+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff239ddf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF239DBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF23AA96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF23A892000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF23A598000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF23A383000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF23A166000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF239DBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF23AC9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff239ddf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:15:47.087+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:16:46.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] MongoDB starting : pid=15055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:16:46.490+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:16:46.543+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:16:46.938+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753006:938491][15055:0x7f1fe3ddbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:16:46.938+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:16:46.958+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1fe2d0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1FE2CEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1FE39C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1FE37BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1FE34C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1FE32AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1FE3092000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1FE2CEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1FE3BCB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1fe2d0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:16:46.958+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:17:46.082+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:17:46.089+0000 I CONTROL [initandlisten] MongoDB starting : pid=15172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:17:46.089+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:17:46.089+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:17:46.089+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:17:46.089+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:17:46.089+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:17:46.090+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:17:46.090+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:17:46.090+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:17:46.139+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:17:46.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753066:459704][15172:0x7fb37802bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:17:46.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:17:46.470+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb376f5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB376F3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB377C12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB377A0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB377714000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB3774FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB3772E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB376F3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB377E1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb376f5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:17:46.470+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:18:46.598+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] MongoDB starting : pid=15464 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:18:46.605+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:18:46.655+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:18:47.081+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753127:81088][15464:0x7f7691c41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:18:47.081+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:18:47.101+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7690b71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7690B50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB0D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7691828000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7691624000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F769132A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7691115000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7690EF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7690B50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7691A31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7690b71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:18:47.101+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:19:46.224+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:19:46.231+0000 I CONTROL [initandlisten] MongoDB starting : pid=15694 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:19:46.232+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:19:46.282+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:19:46.615+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753186:615344][15694:0x7f4052c45c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:19:46.615+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:19:46.625+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4051b75635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4051B54000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE008000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F405282C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4052628000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F405232E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4052119000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4051EFC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4051B54000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4052A35000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4051b75635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:19:46.625+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:20:47.059+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] MongoDB starting : pid=15897 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:20:47.067+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:20:47.118+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:20:47.534+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753247:534800][15897:0x7fb0024e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:20:47.534+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:20:47.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb001419635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0013F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0020D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB001ECC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB001BD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0019BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0017A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0013F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0022D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb001419635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:20:47.555+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:21:47.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] MongoDB starting : pid=16114 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:21:47.058+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:21:47.112+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:21:47.547+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753307:547205][16114:0x7f7726338c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:21:47.547+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:21:47.567+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7725268635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7725247000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7725F1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7725D1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7725A21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F772580C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F77255EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7725247000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7726128000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7725268635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:21:47.568+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:22:46.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:22:46.694+0000 I CONTROL [initandlisten] MongoDB starting : pid=16242 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:22:46.694+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:22:46.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:22:46.744+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:22:47.033+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753367:33475][16242:0x7f0ab7802c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:22:47.033+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:22:47.044+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ab6732635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0AB6711000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91ECA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0AB73E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0AB71E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0AB6EEB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0AB6CD6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0AB6AB9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0AB6711000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0AB75F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ab6732635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:22:47.044+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:23:46.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] MongoDB starting : pid=16519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:23:46.178+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:23:46.228+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:23:46.570+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753426:570971][16519:0x7f358720dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:23:46.571+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:23:46.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f358613d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F358611C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18063000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3586DF4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3586BF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35868F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F35866E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F35864C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F358611C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3586FFD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f358613d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:23:46.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:24:46.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] MongoDB starting : pid=16750 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:24:46.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:24:46.788+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:24:47.080+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753487:80458][16750:0x7fd90ae86c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:24:47.080+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:24:47.091+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd909db6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD909D95000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF762FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD90AA6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD90A869000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD90A56F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD90A35A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD90A13D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD909D95000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD90AC76000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd909db6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:24:47.091+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:25:46.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:25:46.149+0000 I CONTROL [initandlisten] MongoDB starting : pid=16967 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:25:46.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:25:46.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:25:46.558+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753546:558253][16967:0x7fd0d7b6cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:25:46.558+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:25:46.571+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0d6a9c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0D6A7B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03E47000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD0D7753000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0D754F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0D7255000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0D7040000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0D6E23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0D6A7B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0D795C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0d6a9c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:25:46.571+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:26:47.004+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] MongoDB starting : pid=17187 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:26:47.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:26:47.061+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:26:47.347+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753607:347150][17187:0x7f61d0ba5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:26:47.347+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:26:47.357+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61cfad5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61CFAB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89AF9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61D078C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61D0588000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61D028E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61D0079000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61CFE5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61CFAB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61D0995000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61cfad5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:26:47.357+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:27:46.475+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] MongoDB starting : pid=17314 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:27:46.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:27:46.532+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:27:46.845+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753666:845492][17314:0x7f1c8bc19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:27:46.845+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:27:46.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c8ab49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C8AB28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF268E0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C8B800000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C8B5FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C8B302000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C8B0ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C8AED0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C8AB28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C8BA09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c8ab49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:27:46.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:28:46.988+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] MongoDB starting : pid=17605 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:28:46.996+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:28:47.046+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:28:47.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753727:429084][17605:0x7f3d71764c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:28:47.429+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:28:47.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d70694635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D70673000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF690FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D7134B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D71147000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D70E4D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D70C38000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D70A1B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D70673000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D71554000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d70694635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:28:47.439+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:29:46.575+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] MongoDB starting : pid=17836 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:29:46.583+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:29:46.632+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:29:46.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753786:963995][17836:0x7f5a208ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:29:46.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:29:46.976+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a1f81b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A1F7FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A204D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A202CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A1FFD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A1FDBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A1FBA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A1F7FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A206DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a1f81b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:29:46.976+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:30:46.219+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] MongoDB starting : pid=18036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:30:46.226+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:30:46.277+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:30:46.615+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753846:615097][18036:0x7fb667d9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:30:46.615+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:30:46.625+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb666ccc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB666CAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64773000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB667983000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB66777F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB667485000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB667270000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB667053000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB666CAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB667B8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb666ccc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:30:46.625+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:31:46.095+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] MongoDB starting : pid=18250 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:31:46.103+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:31:46.154+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:31:46.452+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753906:452957][18250:0x7fae1ba80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:31:46.453+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:31:46.472+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fae1a9b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAE1A98F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAE1B667000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAE1B463000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAE1B169000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAE1AF54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAE1AD37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAE1A98F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAE1B870000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fae1a9b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:31:46.472+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:32:46.605+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] MongoDB starting : pid=18371 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:32:46.613+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:32:46.663+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:32:46.980+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507753966:980967][18371:0x7fcc757c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:32:46.981+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:32:46.990+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcc746f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCC746D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAEA79000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCC753AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCC751A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCC74EAD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCC74C98000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCC74A7B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCC746D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCC755B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcc746f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:32:46.990+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:33:46.117+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] MongoDB starting : pid=18649 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:33:46.128+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:33:46.179+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:33:46.567+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754026:567731][18649:0x7f9bf4effc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:33:46.567+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:33:46.587+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9bf3e2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9BF3E0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53672000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9BF4AE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9BF48E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9BF45E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9BF43D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9BF41B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9BF3E0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9BF4CEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9bf3e2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:33:46.587+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:34:46.719+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] MongoDB starting : pid=18880 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:34:46.727+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:34:46.782+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:34:47.120+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754087:120288][18880:0x7f1e64dabc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:34:47.120+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:34:47.130+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e63cdb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E63CBA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E64992000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E6478E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E64494000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E6427F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E64062000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E63CBA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E64B9B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e63cdb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:34:47.130+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:35:46.247+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:35:46.254+0000 I CONTROL [initandlisten] MongoDB starting : pid=19083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:35:46.254+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:35:46.255+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:35:46.304+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:35:46.714+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754146:714755][19083:0x7fc7b805cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:35:46.714+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:35:46.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7b6f8c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7B6F6B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17EC6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7B7C43000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7B7A3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7B7745000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7B7530000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7B7313000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7B6F6B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7B7E4C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7b6f8c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:35:46.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:36:46.216+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] MongoDB starting : pid=19298 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:36:46.225+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:36:46.274+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:36:46.607+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754206:607635][19298:0x7f9a05735c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:36:46.607+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:36:46.619+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a04665635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A04644000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A0531C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A05118000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A04E1E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A04C09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A049EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A04644000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A05525000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a04665635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:36:46.619+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:37:46.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] MongoDB starting : pid=19414 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:37:46.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:37:46.812+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:37:47.123+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754267:123892][19414:0x7fd6a2f0dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:37:47.123+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:37:47.134+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd6a1e3d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD6A1E1C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF484FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD6A2AF4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6A28F0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD6A25F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD6A23E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD6A21C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD6A1E1C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD6A2CFD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd6a1e3d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:37:47.134+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:38:46.271+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:38:46.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=19701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:38:46.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:38:46.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:38:46.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:38:46.279+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:38:46.279+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:38:46.279+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:38:46.279+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:38:46.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:38:46.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:38:46.684+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754326:684293][19701:0x7ffb4a783c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:38:46.684+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:38:46.694+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb496b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB49692000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5709E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB4A36A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB4A166000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB49E6C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB49C57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB49A3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB49692000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB4A573000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb496b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:38:46.694+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:39:46.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=19928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:39:46.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:39:46.899+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:39:47.233+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754387:233181][19928:0x7f3b5699cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:39:47.233+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:39:47.246+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b558cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B558AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB14FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3B56583000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3B5637F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3B56085000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3B55E70000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B55C53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B558AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3B5678C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b558cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:39:47.246+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:40:46.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] MongoDB starting : pid=20132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:40:46.382+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:40:46.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:40:46.835+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754446:835040][20132:0x7fbca0571c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:40:46.835+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:40:46.854+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc9f4a1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC9F480000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E0B6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBCA0158000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC9FF54000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC9FC5A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC9FA45000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC9F828000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC9F480000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBCA0361000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc9f4a1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:40:46.854+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:41:46.270+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=20343 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:41:46.278+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:41:46.327+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:41:46.733+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754506:733158][20343:0x7f7cdc48ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:41:46.733+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:41:46.753+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7cdb3be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CDB39D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CDC075000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CDBE71000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CDBB77000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CDB962000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CDB745000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CDB39D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CDC27E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7cdb3be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:41:46.753+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:42:46.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:42:46.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=20480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:42:46.882+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:42:46.882+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:42:46.882+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:42:46.883+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:42:46.883+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:42:46.883+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:42:46.883+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:42:46.883+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:42:46.932+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:42:47.295+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754567:295892][20480:0x7fb56a750c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:42:47.295+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:42:47.307+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb569680635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB56965F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB56A337000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB56A133000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB569E39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB569C24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB569A07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB56965F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB56A540000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb569680635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:42:47.307+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:43:46.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] MongoDB starting : pid=20643 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:43:46.437+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:43:46.488+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:43:46.899+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754626:899286][20643:0x7fcca69bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:43:46.899+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:43:46.919+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcca58ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCA58CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCA65A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCA639F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCA60A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCA5E90000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCA5C73000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCA58CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCA67AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcca58ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:43:46.920+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:44:47.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] MongoDB starting : pid=20925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:44:47.042+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:44:47.094+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:44:47.508+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754687:508934][20925:0x7fa274102c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:44:47.509+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:44:47.528+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa273032635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA273011000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CA30000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA273CE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA273AE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA2737EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA2735D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA2733B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA273011000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA273EF2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa273032635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:44:47.528+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:45:46.662+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] MongoDB starting : pid=21127 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:45:46.670+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:45:46.726+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:45:47.128+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754747:128598][21127:0x7fb910645c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:45:47.128+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:45:47.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb90f575635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB90F554000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB91022C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB910028000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB90FD2E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB90FB19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB90F8FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB90F554000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB910435000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb90f575635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:45:47.148+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:46:46.936+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] MongoDB starting : pid=21331 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:46:46.943+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:46:46.993+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:46:47.316+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754807:316319][21331:0x7ff63c304c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:46:47.316+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:46:47.327+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff63b234635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF63B213000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF63BEEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF63BCE7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF63B9ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF63B7D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF63B5BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF63B213000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF63C0F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff63b234635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:46:47.327+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:47:46.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=21542 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:47:46.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:47:46.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:47:46.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754866:910242][21542:0x7fc730ac9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:47:46.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:47:46.920+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc72f9f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC72F9D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7306B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7304AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7301B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC72FF9D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC72FD80000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC72F9D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7308B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc72f9f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:47:46.920+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:48:47.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=21686 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:48:47.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:48:47.105+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:48:47.483+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754927:483046][21686:0x7f0d4793ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:48:47.483+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:48:47.505+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d4686a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D46849000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D47521000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D4731D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D47023000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D46E0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D46BF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D46849000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D4772A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d4686a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:48:47.505+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:49:46.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:49:46.637+0000 I CONTROL [initandlisten] MongoDB starting : pid=21968 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:49:46.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:49:46.687+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:49:47.025+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507754987:25644][21968:0x7fd9398f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:49:47.025+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:49:47.036+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd938821635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD938800000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD9394D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD9392D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD938FDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD938DC5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD938BA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD938800000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD9396E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd938821635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:49:47.036+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:50:46.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] MongoDB starting : pid=22175 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:50:46.177+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:50:46.227+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:50:46.610+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755046:610053][22175:0x7fce3bdfdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:50:46.610+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:50:46.629+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce3ad2d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE3AD0C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "800000089000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE3B9E4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE3B7E0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE3B4E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE3B2D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE3B0B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE3AD0C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE3BBED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce3ad2d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:50:46.629+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:51:46.097+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=22388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:51:46.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:51:46.157+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:51:46.481+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755106:481866][22388:0x7f9252950c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:51:46.481+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:51:46.493+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9251880635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F925185F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E388000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9252537000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9252333000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9252039000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9251E24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9251C07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F925185F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9252740000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9251880635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:51:46.494+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:52:46.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=22602 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:52:46.622+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:52:46.675+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:52:47.008+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755167:8646][22602:0x7f9f2542bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:52:47.008+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:52:47.019+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9f2435b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9F2433A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF23242000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9F25012000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9F24E0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9F24B14000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9F248FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9F246E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9F2433A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9F2521B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9f2435b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:52:47.019+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:53:46.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=22744 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:53:46.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:53:46.197+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:53:46.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755226:608329][22744:0x7f1502724c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:53:46.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:53:46.628+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1501654635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1501633000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F150230B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1502107000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1501E0D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1501BF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15019DB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1501633000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1502514000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1501654635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:53:46.628+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:54:46.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] MongoDB starting : pid=23035 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:54:46.769+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:54:46.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:54:47.131+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755287:131508][23035:0x7f0efbb90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:54:47.131+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:54:47.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0efaac0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EFAA9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF632C2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EFB777000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EFB573000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EFB279000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EFB064000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EFAE47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EFAA9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EFB980000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0efaac0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:54:47.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:55:46.271+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=23234 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:55:46.278+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:55:46.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:55:46.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:55:46.676+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755346:676172][23234:0x7f11f0dc1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:55:46.676+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:55:46.696+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f11efcf1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F11EFCD0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9DDC0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F11F09A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F11F07A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F11F04AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F11F0295000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F11F0078000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F11EFCD0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F11F0BB1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f11efcf1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:55:46.696+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:56:46.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] MongoDB starting : pid=23442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:56:46.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:56:46.261+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:56:46.531+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755406:531514][23442:0x7f5a54176c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:56:46.531+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:56:46.541+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a530a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A53085000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF506FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A53D5D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A53B59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A5385F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A5364A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A5342D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A53085000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A53F66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a530a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:56:46.541+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:57:46.666+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] MongoDB starting : pid=23661 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:57:46.673+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:57:46.730+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:57:47.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755467:129605][23661:0x7ff10059fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:57:47.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:57:47.149+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff0ff4cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0FF4AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9622A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF100186000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF0FFF82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF0FFC88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF0FFA73000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF0FF856000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0FF4AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF10038F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff0ff4cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:57:47.149+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:58:46.265+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:58:46.272+0000 I CONTROL [initandlisten] MongoDB starting : pid=23812 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:58:46.273+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:58:46.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:58:46.669+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755526:669970][23812:0x7f59f3905c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:58:46.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:58:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59f2835635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59F2814000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E4BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59F34EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59F32E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59F2FEE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59F2DD9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59F2BBC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59F2814000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59F36F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59f2835635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:58:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T20:59:46.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=24100 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] modules: none 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] build environment: 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T20:59:46.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T20:59:46.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T20:59:47.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755587:261374][24100:0x7f120b891c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T20:59:47.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T20:59:47.280+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f120a7c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F120A7A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F120B478000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F120B274000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F120AF7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F120AD65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F120AB48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F120A7A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F120B681000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f120a7c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T20:59:47.280+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:00:46.400+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] MongoDB starting : pid=24303 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:00:46.407+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:00:46.408+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:00:46.458+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:00:46.852+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755646:852590][24303:0x7fcfb786ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:00:46.852+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:00:46.872+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcfb679a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCFB6779000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBA9C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFB7451000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFB724D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFB6F53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFB6D3E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFB6B21000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCFB6779000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFB765A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcfb679a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:00:46.872+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:01:46.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:01:46.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=24510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:01:46.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:01:46.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:01:46.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:01:46.810+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:01:46.810+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:01:46.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:01:46.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:01:46.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:01:46.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:01:47.208+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755707:208850][24510:0x7f2728082c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:01:47.208+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:01:47.219+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2726fb2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2726F91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC41E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2727C69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2727A65000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F272776B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2727556000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2727339000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2726F91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2727E72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2726fb2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:01:47.219+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:02:46.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] MongoDB starting : pid=24726 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:02:46.795+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:02:46.845+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:02:47.206+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755767:206465][24726:0x7f4adca29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:02:47.206+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:02:47.217+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4adb959635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4ADB938000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF694FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4ADC610000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4ADC40C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4ADC112000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4ADBEFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4ADBCE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4ADB938000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4ADC819000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4adb959635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:02:47.217+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:03:46.347+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] MongoDB starting : pid=24869 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:03:46.354+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:03:46.406+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:03:46.802+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755826:802191][24869:0x7f74d97fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:03:46.802+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:03:46.821+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74d872a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74D8709000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74D93E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74D91DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74D8EE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F74D8CCE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F74D8AB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74D8709000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74D95EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74d872a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:03:46.821+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:04:46.940+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] MongoDB starting : pid=25159 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:04:46.948+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:04:46.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:04:47.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755887:408730][25159:0x7f1b5edb8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:04:47.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:04:47.428+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b5dce8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B5DCC7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B5E99F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B5E79B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B5E4A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B5E28C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B5E06F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B5DCC7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B5EBA8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b5dce8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:04:47.428+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:05:46.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=25365 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:05:46.565+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:05:46.614+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:05:47.017+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507755947:17774][25365:0x7f5892e8cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:05:47.017+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:05:47.031+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5891dbc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5891D9B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA84BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5892A73000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F589286F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5892575000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5892360000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5892143000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5891D9B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5892C7C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5891dbc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:05:47.031+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:06:46.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:06:46.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=25573 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:06:46.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:06:46.674+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:06:47.034+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756007:34549][25573:0x7f7beb376c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:06:47.034+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:06:47.046+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7bea2a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7BEA285000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB46FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7BEAF5D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7BEAD59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7BEAA5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7BEA84A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7BEA62D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7BEA285000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7BEB166000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7bea2a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:06:47.046+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:07:46.165+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=25783 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:07:46.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:07:46.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:07:46.616+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756066:616199][25783:0x7f87814d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:07:46.616+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:07:46.636+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8780408635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87803E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5FCBC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F87810BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8780EBB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8780BC1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F87809AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F878078F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87803E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87812C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8780408635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:07:46.636+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:08:46.770+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:08:46.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=25929 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:08:46.783+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:08:46.837+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:08:47.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756127:173712][25929:0x7fe4321e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:08:47.173+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:08:47.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe431118635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4310F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA7EB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE431DCF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE431BCB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4318D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4316BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE43149F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4310F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE431FD8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe431118635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:08:47.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:09:46.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=26204 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:09:46.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:09:46.361+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:09:46.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756186:707534][26204:0x7f52b3451c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:09:46.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:09:46.718+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52b2381635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52B2360000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52B3038000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52B2E34000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52B2B3A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52B2925000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52B2708000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52B2360000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52B3241000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52b2381635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:09:46.718+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:10:46.839+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] MongoDB starting : pid=26418 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:10:46.846+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:10:46.897+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:10:47.275+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756247:275935][26418:0x7f492cb2dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:10:47.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:10:47.295+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f492ba5d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F492BA3C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC32F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F492C714000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F492C510000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F492C216000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F492C001000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F492BDE4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F492BA3C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F492C91D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f492ba5d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:10:47.295+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:11:46.688+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:11:46.695+0000 I CONTROL [initandlisten] MongoDB starting : pid=26629 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:11:46.695+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:11:46.696+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:11:46.745+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:11:47.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756307:132386][26629:0x7f8efb7b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:11:47.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:11:47.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8efa6e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EFA6C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCCEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EFB39B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EFB197000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EFAE9D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EFAC88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EFAA6B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EFA6C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EFB5A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8efa6e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:11:47.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:12:46.269+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] MongoDB starting : pid=26842 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:12:46.276+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:12:46.326+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:12:46.743+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756366:743898][26842:0x7f65e3ff4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:12:46.743+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:12:46.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65e2f24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65E2F03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7FBEA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65E3BDB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65E39D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65E36DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65E34C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65E32AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65E2F03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65E3DE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65e2f24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:12:46.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:13:46.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=26994 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:13:46.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:13:46.958+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:13:47.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756427:266634][26994:0x7f720708bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:13:47.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:13:47.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7205fbb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7205F9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF234FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7206C72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7206A6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7206774000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F720655F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7206342000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7205F9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7206E7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7205fbb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:13:47.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:14:46.416+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] MongoDB starting : pid=27275 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:14:46.423+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:14:46.424+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:14:46.474+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:14:46.830+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756486:830746][27275:0x7f390b2b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:14:46.830+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:14:46.850+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f390a1e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F390A1C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF416C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F390AE9D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F390AC99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F390A99F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F390A78A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F390A56D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F390A1C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F390B0A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f390a1e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:14:46.850+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:15:46.978+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] MongoDB starting : pid=27494 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:15:46.990+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:15:47.042+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:15:47.378+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756547:378599][27494:0x7f24e6b97c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:15:47.378+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:15:47.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24e5ac7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24E5AA6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F24E677E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F24E657A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F24E6280000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F24E606B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F24E5E4E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24E5AA6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24E6987000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24e5ac7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:15:47.390+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:16:46.834+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] MongoDB starting : pid=27708 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:16:46.842+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:16:46.892+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:16:47.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756607:243031][27708:0x7f43ab1eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:16:47.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:16:47.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f43aa11e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F43AA0FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC17F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F43AADD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F43AABD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F43AA8D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43AA6C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F43AA4A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F43AA0FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F43AAFDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f43aa11e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:16:47.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:17:46.380+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] MongoDB starting : pid=27919 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:17:46.388+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:17:46.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:17:46.802+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756666:802886][27919:0x7f3cf603cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:17:46.802+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:17:46.822+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3cf4f6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3CF4F4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD3A36000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3CF5C23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3CF5A1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3CF5725000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3CF5510000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3CF52F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3CF4F4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3CF5E2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3cf4f6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:17:46.822+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:18:46.950+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=28067 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:18:46.958+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:18:47.011+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:18:47.378+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756727:378899][28067:0x7f0d234aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:18:47.378+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:18:47.398+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d223da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D223B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D23091000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D22E8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D22B93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D2297E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D22761000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D223B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D2329A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d223da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:18:47.398+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:19:46.522+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] MongoDB starting : pid=28185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:19:46.529+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:19:46.579+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:19:46.875+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756786:875911][28185:0x7fb393667c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:19:46.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:19:46.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb392597635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB392576000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB39324E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB39304A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB392D50000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB392B3B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB39291E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB392576000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB393457000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb392597635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:19:46.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:20:47.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] MongoDB starting : pid=28456 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:20:47.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:20:47.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:20:47.401+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756847:401213][28456:0x7f5fa9a48c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:20:47.401+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:20:47.420+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5fa8978635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5FA8957000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF212FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5FA962F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5FA942B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5FA9131000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5FA8F1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5FA8CFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5FA8957000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5FA9838000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5fa8978635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:20:47.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:21:46.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] MongoDB starting : pid=28658 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:21:46.250+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:21:46.300+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:21:46.677+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756906:677279][28658:0x7facd2a4ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:21:46.677+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:21:46.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7facd197e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FACD195D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FACD2635000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FACD2431000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FACD2137000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FACD1F22000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FACD1D05000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FACD195D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FACD283E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7facd197e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:21:46.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:22:46.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=28871 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:22:46.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:22:46.870+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:22:47.227+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507756967:227118][28871:0x7f3da920fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:22:47.227+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:22:47.246+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3da813f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DA811E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DA8DF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DA8BF2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DA88F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DA86E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DA84C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DA811E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DA8FFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3da813f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:22:47.246+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:23:46.370+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=29094 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:23:46.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:23:46.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:23:46.713+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757026:713363][29094:0x7f539605cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:23:46.713+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:23:46.723+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5394f8c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5394F6B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24590000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5395C43000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5395A3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5395745000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5395530000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5395313000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5394F6B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5395E4C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5394f8c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:23:46.723+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:24:46.858+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] MongoDB starting : pid=29220 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:24:46.865+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:24:46.866+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:24:46.866+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:24:46.915+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:24:47.304+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757087:304321][29220:0x7fcddf86ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:24:47.304+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:24:47.324+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcdde79a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCDDE779000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86CAC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCDDF451000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCDDF24D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCDDEF53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCDDED3E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCDDEB21000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCDDE779000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCDDF65A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcdde79a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:24:47.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:25:46.452+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=29491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:25:46.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:25:46.511+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:25:46.851+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757146:851462][29491:0x7f487371fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:25:46.851+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:25:46.862+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f487264f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F487262E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4873306000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4873102000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4872E08000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4872BF3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F48729D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F487262E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F487350F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f487264f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:25:46.862+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:26:46.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=29697 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:26:46.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:26:46.392+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:26:46.722+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757206:722491][29697:0x7f5fee6abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:26:46.722+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:26:46.741+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5fed5db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5FED5BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC3DBF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5FEE292000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5FEE08E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5FEDD94000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5FEDB7F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5FED962000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5FED5BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5FEE49B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5fed5db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:26:46.741+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:27:46.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:27:46.870+0000 I CONTROL [initandlisten] MongoDB starting : pid=29906 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:27:46.870+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:27:46.870+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:27:46.870+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:27:46.871+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:27:46.871+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:27:46.871+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:27:46.871+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:27:46.871+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:27:46.921+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:27:47.282+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757267:282629][29906:0x7fc388d11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:27:47.282+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:27:47.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc387c41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC387C20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF834F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3888F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3886F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3883FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3881E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC387FC8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC387C20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC388B01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc387c41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:27:47.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:28:46.413+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] MongoDB starting : pid=30141 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:28:46.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:28:46.450+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:28:46.726+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757326:726009][30141:0x7f58cb02bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:28:46.726+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:28:46.745+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58c9f5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58C9F3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12E1F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58CAC12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58CAA0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58CA714000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58CA4FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58CA2E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58C9F3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58CAE1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58c9f5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:28:46.745+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:29:46.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=30266 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:29:46.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:29:46.940+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:29:47.214+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757387:214814][30266:0x7f4eb54aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:29:47.214+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:29:47.225+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4eb43de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4EB43BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD2DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4EB5095000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4EB4E91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4EB4B97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4EB4982000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4EB4765000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4EB43BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4EB529E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4eb43de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:29:47.225+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:30:46.361+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] MongoDB starting : pid=30555 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:30:46.373+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:30:46.421+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:30:46.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757446:702890][30555:0x7f262d407c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:30:46.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:30:46.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f262c337635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F262C316000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEFEF3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F262CFEE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F262CDEA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F262CAF0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F262C8DB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F262C6BE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F262C316000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F262D1F7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f262c337635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:30:46.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:31:46.394+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] MongoDB starting : pid=30759 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:31:46.401+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:31:46.451+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:31:46.721+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757506:721950][30759:0x7f20ad627c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:31:46.722+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:31:46.732+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f20ac557635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F20AC536000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F20AD20E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F20AD00A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20ACD10000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F20ACAFB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F20AC8DE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F20AC536000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F20AD417000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f20ac557635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:31:46.732+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:32:46.854+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=30971 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:32:46.862+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:32:46.912+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:32:47.316+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757567:316450][30971:0x7f344f992c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:32:47.316+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:32:47.336+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f344e8c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F344E8A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08622000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F344F579000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F344F375000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F344F07B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F344EE66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F344EC49000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F344E8A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F344F782000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f344e8c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:32:47.336+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:33:46.455+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] MongoDB starting : pid=31182 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:33:46.463+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:33:46.513+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:33:46.867+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757626:867051][31182:0x7fb1de748c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:33:46.867+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:33:46.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb1dd678635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1DD657000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0825D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB1DE32F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1DE12B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB1DDE31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB1DDC1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1DD9FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1DD657000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB1DE538000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb1dd678635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:33:46.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:34:47.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] MongoDB starting : pid=31315 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:34:47.013+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:34:47.063+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:34:47.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757687:463758][31315:0x7f94632f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:34:47.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:34:47.483+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9462226635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9462205000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEABB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9462EDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9462CD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F94629DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F94627CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F94625AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9462205000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94630E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9462226635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:34:47.483+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:35:46.605+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] MongoDB starting : pid=31608 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:35:46.613+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:35:46.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:35:47.004+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757747:4923][31608:0x7f7277bf2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:35:47.005+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:35:47.024+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7276b22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7276B01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD35BC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F72777D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F72775D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F72772DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F72770C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7276EA9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7276B01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F72779E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7276b22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:35:47.024+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:36:46.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] MongoDB starting : pid=31814 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:36:46.901+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:36:46.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:36:47.268+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757807:268173][31814:0x7fc27e6bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:36:47.268+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:36:47.278+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc27d5ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC27D5CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98221000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC27E2A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC27E0A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC27DDA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC27DB92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC27D975000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC27D5CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC27E4AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc27d5ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:36:47.278+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:37:46.400+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] MongoDB starting : pid=32024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:37:46.408+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:37:46.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:37:46.838+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757866:838320][32024:0x7f7234644c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:37:46.838+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:37:46.848+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7233574635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7233553000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE38E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F723422B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7234027000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7233D2D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7233B18000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F72338FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7233553000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7234434000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7233574635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:37:46.848+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:38:46.980+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:38:46.987+0000 I CONTROL [initandlisten] MongoDB starting : pid=32235 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:38:46.988+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:38:47.041+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:38:47.460+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757927:460242][32235:0x7f03a1e3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:38:47.460+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:38:47.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f03a0d6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F03A0D4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06199000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F03A1A23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F03A181F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F03A1525000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F03A1310000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F03A10F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F03A0D4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F03A1C2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f03a0d6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:38:47.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:39:46.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] MongoDB starting : pid=32377 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:39:46.621+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:39:46.622+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:39:46.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:39:47.098+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507757987:98113][32377:0x7f7ff9caec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:39:47.098+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:39:47.117+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ff8bde635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7FF8BBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7FF9895000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7FF9691000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7FF9397000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7FF9182000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7FF8F65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7FF8BBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7FF9A9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ff8bde635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:39:47.117+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:40:46.237+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] MongoDB starting : pid=32659 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:40:46.245+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:40:46.296+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:40:46.739+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758046:739482][32659:0x7f0b9dc18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:40:46.739+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:40:46.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0b9cb48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0B9CB27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB74FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0B9D7FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0B9D5FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0B9D301000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0B9D0EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0B9CECF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0B9CB27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0B9DA08000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0b9cb48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:40:46.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:41:46.048+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] MongoDB starting : pid=402 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:41:46.055+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:41:46.104+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:41:46.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758106:440026][402:0x7febb416ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:41:46.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:41:46.453+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7febb309e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEBB307D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF844FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEBB3D55000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEBB3B51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEBB3857000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEBB3642000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEBB3425000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEBB307D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEBB3F5E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7febb309e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:41:46.453+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:42:46.575+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] MongoDB starting : pid=625 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:42:46.583+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:42:46.633+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:42:46.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758166:963882][625:0x7f8e0c697c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:42:46.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:42:46.974+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e0b5c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E0B5A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A0DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E0C27E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E0C07A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E0BD80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E0BB6B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E0B94E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E0B5A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E0C487000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e0b5c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:42:46.974+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:43:46.107+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] MongoDB starting : pid=847 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:43:46.114+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:43:46.163+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:43:46.524+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758226:524543][847:0x7f93e76f8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:43:46.524+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:43:46.535+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93e6628635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93E6607000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE6CD4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93E72DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93E70DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93E6DE1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93E6BCC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93E69AF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93E6607000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93E74E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93e6628635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:43:46.535+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:44:46.654+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] MongoDB starting : pid=987 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:44:46.659+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:44:46.660+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:44:46.702+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:44:47.109+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758287:109620][987:0x7fbda317bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:44:47.109+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:44:47.129+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbda20ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBDA208A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBDA2D62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBDA2B5E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBDA2864000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBDA264F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBDA2432000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBDA208A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBDA2F6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbda20ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:44:47.129+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:45:46.254+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] MongoDB starting : pid=1268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:45:46.262+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:45:46.314+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:45:46.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758346:608593][1268:0x7f4a07ccdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:45:46.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:45:46.628+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a06bfd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A06BDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA7E1F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A078B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A076B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A073B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A071A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A06F84000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A06BDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A07ABD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a06bfd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:45:46.628+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:46:46.610+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] MongoDB starting : pid=1476 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:46:46.617+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:46:46.671+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:46:46.945+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758406:945678][1476:0x7f1acc7e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:46:46.945+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:46:46.956+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1acb718635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1ACB6F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1ACC3CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1ACC1CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1ACBED1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1ACBCBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1ACBA9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1ACB6F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1ACC5D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1acb718635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:46:46.956+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:47:46.084+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] MongoDB starting : pid=1681 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:47:46.091+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:47:46.141+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:47:46.502+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758466:502451][1681:0x7f66aca61c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:47:46.502+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:47:46.516+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f66ab991635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F66AB970000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12C74000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F66AC648000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F66AC444000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F66AC14A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F66ABF35000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F66ABD18000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F66AB970000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F66AC851000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f66ab991635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:47:46.516+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:48:46.646+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=1895 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:48:46.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:48:46.703+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:48:47.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758527:70509][1895:0x7fbf06361c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:48:47.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:48:47.089+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbf05291635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBF05270000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC23E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBF05F48000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBF05D44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBF05A4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBF05835000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBF05618000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBF05270000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBF06151000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbf05291635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:48:47.089+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:49:46.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=2026 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:49:46.217+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:49:46.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:49:46.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:49:46.572+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758586:572911][2026:0x7fdf94562c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:49:46.572+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:49:46.583+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf93492635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF93471000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF187FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF94149000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF93F45000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF93C4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF93A36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF93819000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF93471000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF94352000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf93492635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:49:46.584+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:50:46.703+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:50:46.710+0000 I CONTROL [initandlisten] MongoDB starting : pid=2309 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:50:46.710+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:50:46.710+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:50:46.710+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:50:46.711+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:50:46.711+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:50:46.711+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:50:46.711+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:50:46.711+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:50:46.763+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:50:47.098+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758647:98373][2309:0x7fb128768c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:50:47.098+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:50:47.109+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb127698635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB127677000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF280BC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB12834F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB12814B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB127E51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB127C3C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB127A1F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB127677000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB128558000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb127698635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:50:47.109+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:51:46.734+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] MongoDB starting : pid=2512 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:51:46.742+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:51:46.791+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:51:47.098+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758707:98020][2512:0x7fb8f8230c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:51:47.098+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:51:47.108+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb8f7160635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB8F713F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB8F7E17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB8F7C13000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB8F7919000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB8F7704000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB8F74E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB8F713F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB8F8020000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb8f7160635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:51:47.108+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:52:46.229+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] MongoDB starting : pid=2725 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:52:46.236+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:52:46.286+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:52:46.650+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758766:650217][2725:0x7f9d63d7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:52:46.650+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:52:46.669+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d62cad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D62C8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF491E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D63964000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D63760000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D63466000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D63251000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D63034000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D62C8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D63B6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d62cad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:52:46.669+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:53:46.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] MongoDB starting : pid=2940 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:53:46.795+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:53:46.845+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:53:47.186+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758827:186598][2940:0x7f5651001c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:53:47.186+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:53:47.206+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f564ff31635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F564FF10000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB3144000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5650BE8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56509E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56506EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56504D5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56502B8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F564FF10000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5650DF1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f564ff31635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:53:47.206+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:54:46.334+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:54:46.341+0000 I CONTROL [initandlisten] MongoDB starting : pid=3070 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:54:46.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:54:46.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:54:46.699+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758886:699312][3070:0x7fc010a48c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:54:46.699+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:54:46.709+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc00f978635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC00F957000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC01062F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC01042B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC010131000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC00FF1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC00FCFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC00F957000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC010838000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc00f978635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:54:46.709+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:55:46.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=3215 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:55:46.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:55:46.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:55:47.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507758947:209137][3215:0x7f5444e2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:55:47.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:55:47.220+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5443d5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5443D3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61030000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5444A12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F544480E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5444514000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54442FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54440E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5443D3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5444C1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5443d5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:55:47.221+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:56:46.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=3487 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:56:46.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:56:46.173+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:56:46.506+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759006:506919][3487:0x7f2f36899c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:56:46.506+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:56:46.517+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f357c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F357A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF970FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F36480000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F3627C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F35F82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F35D6D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F35B50000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F357A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F36689000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f357c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:56:46.517+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:57:46.648+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] MongoDB starting : pid=3701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:57:46.657+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:57:46.708+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:57:47.090+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759067:90621][3701:0x7f81d3385c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:57:47.090+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:57:47.110+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f81d22b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F81D2294000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B986000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F81D2F6C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F81D2D68000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F81D2A6E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81D2859000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F81D263C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F81D2294000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F81D3175000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f81d22b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:57:47.110+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:58:46.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=3929 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:58:46.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:58:46.287+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:58:46.629+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759126:629680][3929:0x7f4e8987fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:58:46.629+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:58:46.649+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e887af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E8878E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF772A8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E89466000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E89262000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E88F68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E88D53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E88B36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E8878E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E8966F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e887af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:58:46.649+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T21:59:46.770+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] MongoDB starting : pid=4149 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] modules: none 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] build environment: 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T21:59:46.778+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T21:59:46.828+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T21:59:47.252+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759187:252029][4149:0x7f25425b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T21:59:47.252+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T21:59:47.271+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25414e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25414C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD989B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25421A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2541F9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2541CA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2541A8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2541870000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25414C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25423A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25414e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T21:59:47.271+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:00:46.399+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=4301 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:00:46.406+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:00:46.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:00:46.769+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759246:769467][4301:0x7f4b3e76cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:00:46.769+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:00:46.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b3d69c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B3D67B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B3E353000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B3E14F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B3DE55000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B3DC40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B3DA23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B3D67B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B3E55C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b3d69c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:00:46.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:01:46.221+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] MongoDB starting : pid=4555 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:01:46.228+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:01:46.278+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:01:46.538+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759306:538737][4555:0x7f852f574c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:01:46.538+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:01:46.549+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f852e4a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F852E483000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0C0BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F852F15B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F852EF57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F852EC5D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F852EA48000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F852E82B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F852E483000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F852F364000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f852e4a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:01:46.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:02:46.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=4781 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:02:46.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:02:46.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:02:46.534+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759366:534587][4781:0x7f384ef5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:02:46.534+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:02:46.545+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f384de8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F384DE6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD4EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F384EB42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F384E93E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F384E644000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F384E42F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F384E212000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F384DE6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F384ED4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f384de8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:02:46.545+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:03:46.665+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] MongoDB starting : pid=5052 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:03:46.673+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:03:46.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:03:47.058+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759427:58036][5052:0x7fdce0039c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:03:47.058+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:03:47.068+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdcdef69635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCDEF48000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F646000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCDFC20000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCDFA1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCDF722000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCDF50D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCDF2F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCDEF48000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCDFE29000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdcdef69635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:03:47.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:04:46.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] MongoDB starting : pid=5493 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:04:46.212+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:04:46.263+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:04:46.596+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759486:596697][5493:0x7f6f54ce6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:04:46.596+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:04:46.610+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f53c16635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F53BF5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6A7F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F548CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F546C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F543CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F541BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F53F9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F53BF5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F54AD6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f53c16635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:04:46.610+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:05:46.745+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] MongoDB starting : pid=5697 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:05:46.752+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:05:46.802+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:05:47.138+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759547:138183][5697:0x7f416f718c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:05:47.138+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:05:47.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f416e648635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F416E627000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF246FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F416F2FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F416F0FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F416EE01000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F416EBEC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F416E9CF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F416E627000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F416F508000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f416e648635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:05:47.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:06:46.320+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=6129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:06:46.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:06:46.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:06:46.745+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759606:745063][6129:0x7f547b0f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:06:46.745+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:06:46.755+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f547a029635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F547A008000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D003000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F547ACE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F547AADC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F547A7E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F547A5CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F547A3B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F547A008000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F547AEE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f547a029635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:06:46.756+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:07:46.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] MongoDB starting : pid=6480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:07:46.897+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:07:46.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:07:47.347+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759667:347722][6480:0x7f00c79cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:07:47.347+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:07:47.367+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00c68fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00C68D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE626B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00C75B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00C73AD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00C70B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00C6E9E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00C6C81000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00C68D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00C77BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00c68fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:07:47.367+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:08:46.497+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] MongoDB starting : pid=6726 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:08:46.504+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:08:46.556+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:08:46.903+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759726:903490][6726:0x7f6e83093c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:08:46.903+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:08:46.914+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e81fc3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E81FA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DC53000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E82C7A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E82A76000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E8277C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E82567000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E8234A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E81FA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E82E83000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e81fc3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:08:46.914+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:09:47.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:09:47.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=6952 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:09:47.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:09:47.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:09:47.506+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759787:506384][6952:0x7f4e6ec9dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:09:47.506+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:09:47.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e6dbcd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E6DBAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB84FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E6E884000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E6E680000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E6E386000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E6E171000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E6DF54000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E6DBAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E6EA8D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e6dbcd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:09:47.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:10:46.656+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:10:46.663+0000 I CONTROL [initandlisten] MongoDB starting : pid=7097 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:10:46.663+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:10:46.664+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:10:46.714+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:10:47.010+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759847:10067][7097:0x7feef27cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:10:47.010+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:10:47.020+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feef16fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEEF16D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF684FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEEF23B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEEF21AD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEEF1EB3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEEF1C9E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEEF1A81000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEEF16D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEEF25BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feef16fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:10:47.020+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:11:46.557+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] MongoDB starting : pid=7365 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:11:46.564+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:11:46.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:11:50.121+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759910:121646][7365:0x7fa763d5ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:11:50.121+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:11:50.141+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa762c8e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA762C6D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF834FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA763945000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA763741000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA763447000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA763232000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA763015000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA762C6D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA763B4E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa762c8e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:11:50.141+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:12:46.275+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] MongoDB starting : pid=7653 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:12:46.284+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:12:46.340+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:12:46.717+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507759966:717300][7653:0x7f5a1f26bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:12:46.717+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:12:46.737+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a1e19b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A1E17A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A1EE52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A1EC4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A1E954000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A1E73F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A1E522000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A1E17A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A1F05B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a1e19b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:12:46.737+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:13:46.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] MongoDB starting : pid=7875 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:13:46.871+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:13:46.921+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:13:47.248+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760027:248344][7875:0x7f2ef480fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:13:47.248+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:13:47.258+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ef373f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2EF371E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2EF43F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2EF41F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2EF3EF8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2EF3CE3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2EF3AC6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2EF371E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2EF45FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ef373f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:13:47.258+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:14:46.393+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] MongoDB starting : pid=8097 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:14:46.404+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:14:46.455+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:14:46.856+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760086:856692][8097:0x7fb1a23f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:14:46.856+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:14:46.876+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb1a1327635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1A1306000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC06BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB1A1FDE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1A1DDA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB1A1AE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB1A18CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1A16AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1A1306000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB1A21E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb1a1327635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:14:46.876+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:15:46.999+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] MongoDB starting : pid=8240 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:15:47.007+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:15:47.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:15:47.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760147:459103][8240:0x7f160d12ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:15:47.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:15:47.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f160c05e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F160C03D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93CC5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F160CD15000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F160CB11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F160C817000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F160C602000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F160C3E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F160C03D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F160CF1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f160c05e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:15:47.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:16:46.913+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] MongoDB starting : pid=8549 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:16:46.921+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:16:46.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:16:47.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760207:243839][8549:0x7f94437b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:16:47.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:16:47.263+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94426e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F94426C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE2DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F944339C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9443198000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9442E9E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9442C89000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9442A6C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F94426C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94435A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94426e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:16:47.263+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:17:46.955+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] MongoDB starting : pid=8767 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:17:46.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:17:47.016+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:17:47.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760267:287570][8767:0x7f62c6639c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:17:47.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:17:47.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62c5569635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62C5548000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0264F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62C6220000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62C601C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62C5D22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62C5B0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62C58F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62C5548000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62C6429000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62c5569635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:17:47.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:18:46.412+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] MongoDB starting : pid=8988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:18:46.420+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:18:46.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:18:46.818+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760326:818104][8988:0x7f1ee3bd2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:18:46.818+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:18:46.828+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1ee2b02635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1EE2AE1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF414AE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1EE37B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1EE35B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1EE32BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1EE30A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1EE2E89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1EE2AE1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1EE39C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1ee2b02635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:18:46.828+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:19:46.948+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] MongoDB starting : pid=9213 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:19:46.957+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:19:47.006+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:19:47.357+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760387:357207][9213:0x7f8294047c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:19:47.357+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:19:47.376+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8292f77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8292F56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8293C2E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8293A2A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8293730000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F829351B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F82932FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8292F56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8293E37000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8292f77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:19:47.377+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:20:46.507+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] MongoDB starting : pid=9356 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:20:46.515+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:20:46.565+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:20:46.880+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760446:880634][9356:0x7f5d8c9d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:20:46.880+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:20:46.900+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d8b906635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D8B8E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8ACF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D8C5BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D8C3B9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D8C0BF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D8BEAA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D8BC8D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D8B8E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D8C7C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d8b906635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:20:46.900+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:21:46.383+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] MongoDB starting : pid=9621 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:21:46.391+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:21:46.441+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:21:46.870+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760506:870778][9621:0x7f09a3c5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:21:46.870+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:21:46.890+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09a2b8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09A2B6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09A3842000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09A363E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09A3344000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09A312F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09A2F12000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09A2B6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09A3A4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09a2b8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:21:46.890+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:22:47.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] MongoDB starting : pid=9826 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:22:47.042+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:22:47.093+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:22:47.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760567:416392][9826:0x7fd682f5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:22:47.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:22:47.435+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd681e8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD681E6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD682B42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD68293E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD682644000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD68242F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD682212000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD681E6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD682D4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd681e8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:22:47.435+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:23:46.570+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=10043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:23:46.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:23:46.627+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:23:47.034+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760627:34590][10043:0x7ffe14f15c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:23:47.034+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:23:47.045+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe13e45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE13E24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA22FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE14AFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE148F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE145FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE143E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE141CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE13E24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE14D05000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe13e45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:23:47.045+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:24:46.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=10264 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:24:46.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:24:46.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:24:46.626+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760686:626197][10264:0x7f2b9ef10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:24:46.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:24:46.645+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b9de40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B9DE1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C7DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B9EAF7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B9E8F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B9E5F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B9E3E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B9E1C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B9DE1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B9ED00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b9de40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:24:46.645+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:25:46.771+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] MongoDB starting : pid=10410 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:25:46.780+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:25:46.831+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:25:47.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760747:266075][10410:0x7f46640a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:25:47.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:25:47.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4662fd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4662FB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42856000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4663C88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4663A84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F466378A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4663575000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4663358000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4662FB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4663E91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4662fd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:25:47.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:26:46.747+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] MongoDB starting : pid=10665 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:26:46.755+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:26:46.806+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:26:47.183+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760807:183708][10665:0x7fa68e918c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:26:47.183+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:26:47.203+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa68d848635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA68D827000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9A29000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA68E4FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA68E2FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA68E001000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA68DDEC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA68DBCF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA68D827000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA68E708000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa68d848635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:26:47.203+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:27:46.286+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=10863 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:27:46.294+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:27:46.344+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:27:46.725+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760866:725223][10863:0x7fa7fe8d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:27:46.725+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:27:46.736+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7fd801635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7FD7E0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC50FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7FE4B8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7FE2B4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7FDFBA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7FDDA5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7FDB88000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7FD7E0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7FE6C1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7fd801635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:27:46.736+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:28:46.860+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] MongoDB starting : pid=11090 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:28:46.868+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:28:46.918+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:28:47.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760927:276414][11090:0x7ffda0904c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:28:47.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:28:47.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd9f834635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD9F813000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF166FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFDA04EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFDA02E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD9FFED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD9FDD8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD9FBBB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD9F813000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFDA06F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd9f834635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:28:47.287+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:29:46.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:29:46.414+0000 I CONTROL [initandlisten] MongoDB starting : pid=11280 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:29:46.415+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:29:46.472+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:29:46.882+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507760986:882427][11280:0x7f953362cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:29:46.882+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:29:46.902+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f953255c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F953253B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0FD3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9533213000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F953300F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9532D15000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9532B00000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F95328E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F953253B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F953341C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f953255c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:29:46.902+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:30:47.041+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=11444 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:30:47.049+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:30:47.099+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:30:47.461+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761047:461217][11444:0x7fc39083fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:30:47.461+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:30:47.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc38f76f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC38F74E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F429000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC390426000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC390222000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC38FF28000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC38FD13000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC38FAF6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC38F74E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC39062F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc38f76f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:30:47.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:31:46.846+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] MongoDB starting : pid=11564 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:31:46.853+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:31:46.904+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:31:47.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761107:287768][11564:0x7f92f20b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:31:47.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:31:47.308+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f92f0fe3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F92F0FC2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4EC0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F92F1C9A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F92F1A96000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F92F179C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F92F1587000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F92F136A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F92F0FC2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F92F1EA3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f92f0fe3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:31:47.308+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:32:46.447+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] MongoDB starting : pid=11815 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:32:46.454+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:32:46.504+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:32:46.789+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761166:789129][11815:0x7f9fa8204c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:32:46.789+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:32:46.799+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9fa7134635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9FA7113000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD66DE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9FA7DEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9FA7BE7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9FA78ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9FA76D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9FA74BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9FA7113000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9FA7FF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9fa7134635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:32:46.799+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:33:46.930+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] MongoDB starting : pid=12031 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:33:46.938+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:33:46.987+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:33:47.383+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761227:383011][12031:0x7f2a2d943c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:33:47.383+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:33:47.402+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2a2c873635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2A2C852000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF96A99000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2A2D52A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2A2D326000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2A2D02C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2A2CE17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2A2CBFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2A2C852000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2A2D733000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2a2c873635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:33:47.402+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:34:46.521+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] MongoDB starting : pid=12273 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:34:46.528+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:34:46.578+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:34:46.884+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761286:884098][12273:0x7f5f2b032c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:34:46.884+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:34:46.897+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5f29f62635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5F29F41000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF168FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5F2AC19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5F2AA15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5F2A71B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5F2A506000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5F2A2E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5F29F41000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5F2AE22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5f29f62635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:34:46.897+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:35:47.026+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] MongoDB starting : pid=12499 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:35:47.033+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:35:47.082+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:35:47.397+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761347:397682][12499:0x7f1eedf43c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:35:47.397+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:35:47.408+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1eece73635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1EECE52000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1EEDB2A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1EED926000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1EED62C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1EED417000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1EED1FA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1EECE52000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1EEDD33000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1eece73635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:35:47.408+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:36:46.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] MongoDB starting : pid=12623 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:36:46.829+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:36:46.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:36:47.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761407:261594][12623:0x7fd8548e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:36:47.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:36:47.281+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd853815635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8537F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4318A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD8544CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD8542C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD853FCE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD853DB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD853B9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8537F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8546D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd853815635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:36:47.281+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:37:46.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] MongoDB starting : pid=12876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:37:46.694+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:37:46.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:37:46.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:37:46.744+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:37:47.101+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761467:101675][12876:0x7f205684ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:37:47.101+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:37:47.112+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f205577a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2055759000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1FEF8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2056431000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F205622D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2055F33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2055D1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2055B01000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2055759000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F205663A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f205577a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:37:47.112+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:38:46.240+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] MongoDB starting : pid=13095 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:38:46.252+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:38:46.312+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:38:46.588+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761526:588123][13095:0x7fa91f966c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:38:46.588+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:38:46.598+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa91e896635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA91E875000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF32FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA91F54D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA91F349000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA91F04F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA91EE3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA91EC1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA91E875000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA91F756000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa91e896635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:38:46.598+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:39:46.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] MongoDB starting : pid=13320 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:39:46.733+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:39:46.785+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:39:47.186+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761587:186751][13320:0x7ff762d22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:39:47.186+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:39:47.197+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff761c52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF761C31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF642F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF762909000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF762705000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF76240B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF7621F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF761FD9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF761C31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF762B12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff761c52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:39:47.197+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:40:46.319+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] MongoDB starting : pid=13550 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:40:46.326+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:40:46.376+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:40:46.733+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761646:733386][13550:0x7f365ca92c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:40:46.733+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:40:46.743+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f365b9c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F365B9A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26479000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F365C679000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F365C475000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F365C17B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F365BF66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F365BD49000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F365B9A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F365C882000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f365b9c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:40:46.743+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:41:46.166+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=13676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:41:46.174+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:41:46.223+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:41:46.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761706:533333][13676:0x7fb7960e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:41:46.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:41:46.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb795013635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB794FF2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF156FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB795CCA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB795AC6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB7957CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB7955B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB79539A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB794FF2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB795ED3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb795013635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:41:46.543+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:42:47.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:42:47.058+0000 I CONTROL [initandlisten] MongoDB starting : pid=13930 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:42:47.059+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:42:47.114+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:42:47.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761767:490231][13930:0x7f36d33f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:42:47.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:42:47.510+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36d2329635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36D2308000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E01C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36D2FE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36D2DDC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36D2AE2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36D28CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36D26B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36D2308000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36D31E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36d2329635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:42:47.510+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:43:46.635+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] MongoDB starting : pid=14159 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:43:46.643+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:43:46.693+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:43:47.037+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761827:37130][14159:0x7f0994966c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:43:47.037+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:43:47.049+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0993896635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0993875000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF35E34000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F099454D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0994349000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F099404F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0993E3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0993C1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0993875000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0994756000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0993896635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:43:47.049+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:44:46.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] MongoDB starting : pid=14410 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:44:46.178+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:44:46.228+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:44:46.535+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761886:535710][14410:0x7f547fd6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:44:46.535+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:44:46.547+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f547ec9d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F547EC7C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F547F954000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F547F750000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F547F456000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F547F241000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F547F024000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F547EC7C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F547FB5D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f547ec9d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:44:46.547+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:45:46.676+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] MongoDB starting : pid=14946 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:45:46.684+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:45:46.733+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:45:47.014+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507761947:14832][14946:0x7f77595d5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:45:47.014+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:45:47.025+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7758505635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F77584E4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C634000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F77591BC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7758FB8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7758CBE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7758AA9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F775888C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F77584E4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F77593C5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7758505635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:45:47.025+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:46:46.447+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:46:46.454+0000 I CONTROL [initandlisten] MongoDB starting : pid=15094 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:46:46.455+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:46:46.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:46:46.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762006:787029][15094:0x7ff402d14c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:46:46.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:46:46.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff401c44635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF401C23000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF256FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF4028FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF4026F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF4023FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF4021E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF401FCB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF401C23000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF402B04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff401c44635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:46:46.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:47:46.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] MongoDB starting : pid=15357 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:47:46.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:47:46.240+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:47:46.538+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762066:538469][15357:0x7fde16640c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:47:46.538+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:47:46.548+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde15570635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE1554F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8338000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE16227000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE16023000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE15D29000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE15B14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE158F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE1554F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE16430000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde15570635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:47:46.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:48:46.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] MongoDB starting : pid=15588 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:48:46.679+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:48:46.731+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:48:47.043+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762127:43705][15588:0x7f098fbecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:48:47.043+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:48:47.054+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f098eb1c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F098EAFB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF274FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F098F7D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F098F5CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F098F2D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F098F0C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F098EEA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F098EAFB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F098F9DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f098eb1c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:48:47.054+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:49:46.178+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:49:46.185+0000 I CONTROL [initandlisten] MongoDB starting : pid=15807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:49:46.185+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:49:46.185+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:49:46.186+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:49:46.186+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:49:46.186+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:49:46.186+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:49:46.186+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:49:46.186+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:49:46.237+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:49:46.546+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762186:546751][15807:0x7fea42454c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:49:46.546+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:49:46.557+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea41384635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA41363000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA4203B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA41E37000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA41B3D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA41928000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA4170B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA41363000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA42244000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea41384635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:49:46.557+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:50:46.680+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] MongoDB starting : pid=16037 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:50:46.688+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:50:46.739+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:50:47.060+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762247:60526][16037:0x7f130dc05c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:50:47.060+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:50:47.071+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f130cb35635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F130CB14000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16A1C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F130D7EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F130D5E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F130D2EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F130D0D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F130CEBC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F130CB14000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F130D9F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f130cb35635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:50:47.071+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:51:46.478+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] MongoDB starting : pid=16160 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:51:46.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:51:46.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:51:46.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:51:46.538+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:51:46.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762306:933684][16160:0x7f208414dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:51:46.933+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:51:46.953+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f208307d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F208305C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F060000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2083D34000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2083B30000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2083836000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2083621000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2083404000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F208305C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2083F3D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f208307d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:51:46.953+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:52:46.401+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] MongoDB starting : pid=16412 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:52:46.408+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:52:46.459+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:52:46.763+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762366:763865][16412:0x7f4a7d1fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:52:46.763+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:52:46.775+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a7c12b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A7C10A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D6FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A7CDE2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A7CBDE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A7C8E4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A7C6CF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A7C4B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A7C10A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A7CFEB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a7c12b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:52:46.775+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:53:46.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=16632 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:53:46.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:53:46.956+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:53:47.271+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762427:271893][16632:0x7fa6701d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:53:47.271+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:53:47.284+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa66f108635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA66F0E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CBF3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA66FDBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA66FBBB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA66F8C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA66F6AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA66F48F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA66F0E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA66FFC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa66f108635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:53:47.284+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:54:46.405+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] MongoDB starting : pid=16852 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:54:46.413+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:54:46.467+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:54:46.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762486:805042][16852:0x7fed4aecfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:54:46.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:54:46.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed49dff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED49DDE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED4AAB6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED4A8B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED4A5B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED4A3A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED4A186000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED49DDE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED4ACBF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed49dff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:54:46.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:55:46.948+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] MongoDB starting : pid=17082 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:55:46.956+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:55:47.006+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:55:47.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762547:409748][17082:0x7f0257f28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:55:47.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:55:47.429+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0256e58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0256E37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0257B0F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F025790B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0257611000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02573FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02571DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0256E37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0257D18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0256e58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:55:47.429+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:56:46.876+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] MongoDB starting : pid=17207 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:56:46.884+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:56:46.935+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:56:47.302+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762607:302312][17207:0x7f10689c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:56:47.302+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:56:47.312+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f10678f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F10678D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF477AD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10685AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10683A9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10680AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1067E9A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1067C7D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F10678D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F10687B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f10678f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:56:47.312+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:57:46.457+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] MongoDB starting : pid=17460 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:57:46.465+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:57:46.519+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:57:46.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762666:896083][17460:0x7f2e8cae0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:57:46.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:57:46.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e8ba10635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E8B9EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF874FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E8C6C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E8C4C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E8C1C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E8BFB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E8BD97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E8B9EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E8C8D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e8ba10635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:57:46.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:58:47.044+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] MongoDB starting : pid=17689 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:58:47.052+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:58:47.108+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:58:47.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762727:463606][17689:0x7f96b1fc6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:58:47.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:58:47.483+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96b0ef6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96B0ED5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE1EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96B1BAD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96B19A9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96B16AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96B149A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96B127D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96B0ED5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96B1DB6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96b0ef6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:58:47.483+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T22:59:46.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=17918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] modules: none 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] build environment: 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T22:59:46.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T22:59:46.666+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T22:59:47.030+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762787:30949][17918:0x7fb5679ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T22:59:47.031+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T22:59:47.044+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb5668fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB5668DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB5675B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB5673AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB5670B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB566EA0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB566C83000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5668DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB5677BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb5668fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T22:59:47.044+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:00:46.172+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=18145 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:00:46.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:00:46.236+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:00:46.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762846:643705][18145:0x7fa6dd986c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:00:46.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:00:46.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6dc8b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6DC895000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76A9F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6DD56D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6DD369000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6DD06F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6DCE5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6DCC3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6DC895000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6DD776000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6dc8b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:00:46.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:01:46.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:01:46.081+0000 I CONTROL [initandlisten] MongoDB starting : pid=18267 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:01:46.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:01:46.131+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:01:46.472+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762906:472367][18267:0x7fbc2f4aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:01:46.472+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:01:46.483+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc2e3de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC2E3BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF458FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC2F095000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC2EE91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC2EB97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC2E982000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC2E765000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC2E3BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC2F29E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc2e3de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:01:46.483+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:02:46.676+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] MongoDB starting : pid=18526 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:02:46.683+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:02:46.736+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:02:47.060+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507762967:60211][18526:0x7f6341397c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:02:47.060+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:02:47.070+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63402c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63402A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6340F7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6340D7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6340A80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F634086B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F634064E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63402A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6341187000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63402c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:02:47.070+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:03:46.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=18743 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:03:46.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:03:46.257+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:03:46.633+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763026:633002][18743:0x7f73785ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:03:46.633+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:03:46.643+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f737751c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F73774FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99A3E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F73781D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7377FCF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7377CD5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7377AC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73778A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F73774FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F73783DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f737751c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:03:46.643+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:04:46.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=18959 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:04:46.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:04:46.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:04:47.162+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763087:162821][18959:0x7fc450794c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:04:47.162+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:04:47.175+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc44f6c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC44F6A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13463000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC45037B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC450177000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC44FE7D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC44FC68000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC44FA4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC44F6A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC450584000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc44f6c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:04:47.175+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:05:46.297+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:05:46.304+0000 I CONTROL [initandlisten] MongoDB starting : pid=19101 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:05:46.305+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:05:46.354+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:05:46.737+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763146:737627][19101:0x7ffc84bd4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:05:46.737+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:05:46.757+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc83b04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC83AE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19CE5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC847BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC845B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC842BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC840A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC83E8B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC83AE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC849C4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc83b04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:05:46.757+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:06:46.141+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] MongoDB starting : pid=19304 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:06:46.152+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:06:46.217+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:06:46.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763206:511808][19304:0x7fb58ed63c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:06:46.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:06:46.522+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb58dc93635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB58DC72000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF504FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB58E94A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB58E746000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB58E44C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB58E237000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB58E01A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB58DC72000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB58EB53000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb58dc93635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:06:46.522+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:07:46.795+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] MongoDB starting : pid=19419 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:07:46.803+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:07:46.853+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:07:47.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763267:276356][19419:0x7f168f3b1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:07:47.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:07:47.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f168e2e1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F168E2C0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE14FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F168EF98000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F168ED94000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F168EA9A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F168E885000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F168E668000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F168E2C0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F168F1A1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f168e2e1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:07:47.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:08:46.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] MongoDB starting : pid=19688 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:08:46.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:08:46.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:08:46.736+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763326:736594][19688:0x7f425ff31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:08:46.736+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:08:46.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f425ee61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F425EE40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA6D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F425FB18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F425F914000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F425F61A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F425F405000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F425F1E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F425EE40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F425FD21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f425ee61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:08:46.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:09:46.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=19907 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:09:46.882+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:09:46.932+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:09:47.215+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763387:215888][19907:0x7f9830eafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:09:47.215+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:09:47.226+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f982fddf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F982FDBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9830A96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9830892000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9830598000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9830383000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9830166000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F982FDBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9830C9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f982fddf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:09:47.226+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:10:46.356+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] MongoDB starting : pid=20140 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:10:46.363+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:10:46.364+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:10:46.364+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:10:46.424+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:10:46.809+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763446:809846][20140:0x7f8f607bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:10:46.809+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:10:46.829+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f5f6ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F5F6CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F603A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F601A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F5FEA6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F5FC91000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F5FA74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F5F6CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F605AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f5f6ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:10:46.829+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:11:46.234+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] MongoDB starting : pid=20350 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:11:46.241+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:11:46.290+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:11:46.635+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763506:635603][20350:0x7f29faf3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:11:46.635+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:11:46.646+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29f9e6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29F9E49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF128FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29FAB21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29FA91D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29FA623000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29FA40E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29FA1F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29F9E49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29FAD2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29f9e6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:11:46.646+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:12:46.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] MongoDB starting : pid=20470 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:12:46.954+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:12:47.004+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:12:47.387+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763567:387754][20470:0x7faf6dafac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:12:47.387+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:12:47.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf6ca2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF6CA09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC6F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF6D6E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF6D4DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF6D1E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF6CFCE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF6CDB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF6CA09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF6D8EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf6ca2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:12:47.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:13:46.535+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] MongoDB starting : pid=20756 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:13:46.543+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:13:46.592+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:13:46.937+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763626:937539][20756:0x7fdcbf9e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:13:46.937+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:13:46.957+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdcbe916635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCBE8F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5197A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCBF5CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCBF3C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCBF0CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCBEEBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCBEC9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCBE8F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCBF7D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdcbe916635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:13:46.957+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:14:46.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=21005 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:14:46.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:14:46.131+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:14:46.400+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763686:400712][21005:0x7f18d0a08c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:14:46.400+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:14:46.420+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18cf938635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18CF917000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18D05EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18D03EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18D00F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18CFEDC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18CFCBF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18CF917000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18D07F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18cf938635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:14:46.420+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:15:46.551+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] MongoDB starting : pid=21233 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:15:46.559+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:15:46.609+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:15:46.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763746:933625][21233:0x7f247179ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:15:46.933+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:15:46.945+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24706ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24706A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF71BB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2471381000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F247117D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2470E83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2470C6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2470A51000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24706A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F247158A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24706ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:15:46.945+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:16:46.344+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=21440 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:16:46.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:16:46.402+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:16:46.786+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763806:786356][21440:0x7f55f9794c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:16:46.786+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:16:46.806+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55f86c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F55F86A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7424A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F55F937B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F55F9177000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F55F8E7D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F55F8C68000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F55F8A4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F55F86A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F55F9584000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55f86c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:16:46.806+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:17:46.407+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] MongoDB starting : pid=21556 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:17:46.415+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:17:46.472+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:17:46.822+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763866:822604][21556:0x7fe7aea34c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:17:46.822+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:17:46.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7ad964635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7AD943000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C0C2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7AE61B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7AE417000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7AE11D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7ADF08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7ADCEB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7AD943000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7AE824000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7ad964635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:17:46.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:18:46.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=21835 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:18:46.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:18:46.971+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:18:47.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:18:47.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763927:395731][21835:0x7f75420f0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:18:47.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:18:47.414+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7541020635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7540FFF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D040000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7541CD7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7541AD3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F75417D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F75415C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F75413A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7540FFF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7541EE0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7541020635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:18:47.415+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:19:46.549+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] MongoDB starting : pid=22056 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:19:46.557+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:19:46.607+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:19:46.936+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507763986:936868][22056:0x7fe44153dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:19:46.937+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:19:46.957+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe44046d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE44044C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE441124000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE440F20000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE440C26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE440A11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4407F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE44044C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE44132D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe44046d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:19:46.957+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:20:46.076+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] MongoDB starting : pid=22287 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:20:46.083+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:20:46.133+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:20:46.402+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764046:402662][22287:0x7fa384a45c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:20:46.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:20:46.413+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa383975635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA383954000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB6417000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA38462C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA384428000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA38412E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA383F19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA383CFC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA383954000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA384835000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa383975635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:20:46.413+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:21:46.788+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] MongoDB starting : pid=22493 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:21:46.796+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:21:46.846+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:21:47.178+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764107:178353][22493:0x7f17e2c09c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:21:47.178+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:21:47.189+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f17e1b39635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F17E1B18000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF173B4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F17E27F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17E25EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17E22F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17E20DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17E1EC0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F17E1B18000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F17E29F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f17e1b39635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:21:47.189+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:22:46.502+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] MongoDB starting : pid=22611 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:22:46.510+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:22:46.559+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:22:46.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764166:837799][22611:0x7fa9816e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:22:46.837+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:22:46.848+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa980617635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9805F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9812CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9810CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA980DD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA980BBB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA98099E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9805F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9814D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa980617635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:22:46.848+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:23:46.966+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] MongoDB starting : pid=22879 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:23:46.973+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:23:47.023+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:23:47.383+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764227:383837][22879:0x7f5047831c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:23:47.383+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:23:47.404+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5046761635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5046740000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC0B5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5047418000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5047214000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5046F1A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5046D05000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5046AE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5046740000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5047621000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5046761635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:23:47.404+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:24:46.541+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:24:46.548+0000 I CONTROL [initandlisten] MongoDB starting : pid=23104 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:24:46.548+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:24:46.548+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:24:46.549+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:24:46.549+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:24:46.549+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:24:46.549+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:24:46.549+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:24:46.549+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:24:46.601+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:24:46.997+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764286:997507][23104:0x7fe132c3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:24:46.997+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:24:47.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe131b6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE131B4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65A4A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE132823000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE13261F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE132325000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE132110000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE131EF3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE131B4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE132A2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe131b6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:24:47.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:25:46.148+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] MongoDB starting : pid=23349 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:25:46.155+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:25:46.207+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:25:46.595+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764346:595399][23349:0x7f5f4bb2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:25:46.595+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:25:46.614+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5f4aa5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5F4AA3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC97E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5F4B712000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5F4B50E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5F4B214000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5F4AFFF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5F4ADE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5F4AA3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5F4B91B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5f4aa5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:25:46.614+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:26:46.086+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] MongoDB starting : pid=23558 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:26:46.093+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:26:46.143+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:26:46.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764406:408472][23558:0x7f756ee66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:26:46.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:26:46.418+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f756dd96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F756DD75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBFFDE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F756EA4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F756E849000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F756E54F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F756E33A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F756E11D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F756DD75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F756EC56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f756dd96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:26:46.419+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:27:46.554+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] MongoDB starting : pid=23680 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:27:46.562+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:27:46.613+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:27:46.971+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764466:971036][23680:0x7f2e29c52c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:27:46.971+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:27:46.990+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e28b82635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E28B61000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF75E61000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E29839000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E29635000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E2933B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E29126000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E28F09000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E28B61000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E29A42000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e28b82635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:27:46.990+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:28:46.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] MongoDB starting : pid=23960 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:28:46.122+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:28:46.171+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:28:46.521+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764526:521589][23960:0x7f07b6679c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:28:46.521+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:28:46.541+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f07b55a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F07B5588000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1A484000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F07B6260000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F07B605C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F07B5D62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F07B5B4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F07B5930000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F07B5588000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F07B6469000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f07b55a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:28:46.541+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:29:46.673+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] MongoDB starting : pid=24179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:29:46.680+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:29:46.730+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:29:47.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764587:3820][24179:0x7f1487549c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:29:47.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:29:47.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1486479635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1486458000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF777D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1487130000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1486F2C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1486C32000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1486A1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1486800000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1486458000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1487339000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1486479635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:29:47.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:30:46.154+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] MongoDB starting : pid=24408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:30:46.161+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:30:46.211+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:30:46.546+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764646:546106][24408:0x7f29ea0c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:30:46.546+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:30:46.565+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29e8ff2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29E8FD1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7641E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29E9CA9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29E9AA5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29E97AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29E9596000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29E9379000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29E8FD1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29E9EB2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29e8ff2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:30:46.565+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:31:46.983+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] MongoDB starting : pid=24616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:31:46.990+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:31:46.991+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:31:47.041+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:31:47.402+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764707:402459][24616:0x7f9aa4a9ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:31:47.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:31:47.422+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9aa39ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9AA39AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6ACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9AA4685000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9AA4481000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9AA4187000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9AA3F72000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9AA3D55000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9AA39AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9AA488E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9aa39ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:31:47.422+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:32:46.801+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=24733 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:32:46.809+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:32:46.858+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:32:47.137+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764767:137391][24733:0x7f59bc26bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:32:47.137+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:32:47.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59bb19b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59BB17A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3A2F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59BBE52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59BBC4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59BB954000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59BB73F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59BB522000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59BB17A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59BC05B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59bb19b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:32:47.147+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:33:46.263+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] MongoDB starting : pid=25003 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:33:46.271+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:33:46.321+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:33:46.618+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764826:618834][25003:0x7fbc10e04c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:33:46.618+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:33:46.629+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc0fd34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC0FD13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4D4C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC109EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC107E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC104ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC102D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC100BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC0FD13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC10BF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc0fd34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:33:46.629+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:34:46.773+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] MongoDB starting : pid=25226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:34:46.781+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:34:46.831+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:34:47.199+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764887:199093][25226:0x7fd022e80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:34:47.199+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:34:47.218+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd021db0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD021D8F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD022A67000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD022863000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD022569000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD022354000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD022137000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD021D8F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD022C70000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd021db0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:34:47.218+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:35:46.348+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] MongoDB starting : pid=25447 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:35:46.355+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:35:46.406+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:35:46.703+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507764946:703561][25447:0x7f13f5c27c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:35:46.703+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:35:46.715+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f13f4b57635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F13F4B36000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF0BAE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F13F580E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F13F560A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F13F5310000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F13F50FB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F13F4EDE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F13F4B36000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F13F5A17000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f13f4b57635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:35:46.715+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:36:46.131+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=25663 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:36:46.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:36:46.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:36:46.501+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765006:501017][25663:0x7fe80c1c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:36:46.501+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:36:46.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe80b0f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE80B0D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21092000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE80BDA9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE80BBA5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE80B8AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE80B696000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE80B479000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE80B0D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE80BFB2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe80b0f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:36:46.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:37:46.831+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] MongoDB starting : pid=25778 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:37:46.839+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:37:46.889+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:37:47.217+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765067:217376][25778:0x7f98346b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:37:47.217+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:37:47.236+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98335e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98335C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6362E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F983429B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9834097000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9833D9D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9833B88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F983396B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98335C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98344A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98335e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:37:47.236+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:38:46.362+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] MongoDB starting : pid=26059 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:38:46.369+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:38:46.418+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:38:46.682+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765126:682037][26059:0x7fd607fddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:38:46.682+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:38:46.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd606f0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD606EEC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD607BC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6079C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD6076C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD6074B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD607294000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD606EEC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD607DCD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd606f0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:38:46.692+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:39:46.812+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] MongoDB starting : pid=26279 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:39:46.820+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:39:46.870+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:39:47.148+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765187:148907][26279:0x7fd021576c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:39:47.148+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:39:47.159+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0204a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD020485000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF189D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD02115D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD020F59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD020C5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD020A4A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD02082D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD020485000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD021366000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0204a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:39:47.159+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:40:46.291+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] MongoDB starting : pid=26406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:40:46.299+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:40:46.349+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:40:46.644+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765246:644632][26406:0x7f208893dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:40:46.644+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:40:46.655+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f208786d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F208784C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F0CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2088524000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2088320000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2088026000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2087E11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2087BF4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F208784C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F208872D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f208786d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:40:46.655+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:41:47.077+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] MongoDB starting : pid=26627 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:41:47.085+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:41:47.134+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:41:47.489+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765307:489758][26627:0x7f3340c76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:41:47.489+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:41:47.502+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f333fba6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F333FB85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF749B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F334085D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3340659000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F334035F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F334014A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F333FF2D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F333FB85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3340A66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f333fba6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:41:47.502+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:42:47.000+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] MongoDB starting : pid=26828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:42:47.008+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:42:47.058+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:42:47.361+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765367:361161][26828:0x7fa3b9b05c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:42:47.361+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:42:47.371+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa3b8a35635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3B8A14000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF609F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3B96EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3B94E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3B91EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3B8FD9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3B8DBC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3B8A14000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3B98F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa3b8a35635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:42:47.371+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:43:46.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] MongoDB starting : pid=26973 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:43:46.506+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:43:46.555+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:43:46.893+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765426:893618][26973:0x7f66ecd5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:43:46.893+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:43:46.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f66ebc8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F66EBC6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A49C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F66EC944000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F66EC740000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F66EC446000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F66EC231000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F66EC014000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F66EBC6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F66ECB4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f66ebc8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:43:46.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:44:47.037+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] MongoDB starting : pid=27250 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:44:47.044+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:44:47.094+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:44:47.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765487:395272][27250:0x7fde91a85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:44:47.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:44:47.405+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde909b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE90994000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBCA5D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE9166C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE91468000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE9116E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE90F59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE90D3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE90994000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE91875000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde909b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:44:47.405+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:45:46.533+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] MongoDB starting : pid=27451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:45:46.541+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:45:46.590+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:45:46.858+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765546:858707][27451:0x7f060df5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:45:46.858+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:45:46.869+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f060ce8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F060CE6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F957000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F060DB46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F060D942000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F060D648000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F060D433000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F060D216000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F060CE6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F060DD4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f060ce8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:45:46.869+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:46:46.270+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] MongoDB starting : pid=27682 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:46:46.278+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:46:46.328+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:46:46.695+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765606:695549][27682:0x7f860fdc5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:46:46.695+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:46:46.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f860ecf5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F860ECD4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BC4F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F860F9AC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F860F7A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F860F4AE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F860F299000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F860F07C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F860ECD4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F860FBB5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f860ecf5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:46:46.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:47:46.144+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:47:46.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=27880 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:47:46.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:47:46.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:47:46.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:47:46.151+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:47:46.151+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:47:46.152+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:47:46.152+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:47:46.152+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:47:46.203+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:47:46.524+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765666:524290][27880:0x7f7d23569c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:47:46.524+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:47:46.534+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d22499635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D22478000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14C24000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D23150000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D22F4C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D22C52000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D22A3D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D22820000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D22478000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D23359000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d22499635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:47:46.534+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:48:46.657+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:48:46.664+0000 I CONTROL [initandlisten] MongoDB starting : pid=28012 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:48:46.664+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:48:46.664+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:48:46.664+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:48:46.664+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:48:46.665+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:48:46.665+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:48:46.665+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:48:46.665+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:48:46.725+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:48:47.071+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765727:71748][28012:0x7f07c30fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:48:47.071+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:48:47.090+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f07c202d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F07C200C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F07C2CE4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F07C2AE0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F07C27E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F07C25D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F07C23B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F07C200C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F07C2EED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f07c202d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:48:47.090+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:49:46.221+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] MongoDB starting : pid=28287 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:49:46.229+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:49:46.280+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:49:46.562+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765786:562007][28287:0x7f048c5dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:49:46.562+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:49:46.572+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f048b50e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F048B4ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCAC51000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F048C1C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F048BFC1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F048BCC7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F048BAB2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F048B895000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F048B4ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F048C3CE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f048b50e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:49:46.572+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:50:46.692+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] MongoDB starting : pid=28491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:50:46.702+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:50:46.754+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:50:47.080+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765847:80933][28491:0x7f1274af5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:50:47.080+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:50:47.091+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1273a25635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1273A04000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1AE91000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12746DC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12744D8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12741DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1273FC9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1273DAC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1273A04000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12748E5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1273a25635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:50:47.091+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:51:46.511+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] MongoDB starting : pid=28731 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:51:46.519+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:51:46.570+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:51:46.942+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765906:942156][28731:0x7fe393468c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:51:46.942+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:51:46.963+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe392398635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE392377000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE39304F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE392E4B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE392B51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE39293C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE39271F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE392377000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE393258000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe392398635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:51:46.963+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:52:46.094+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] MongoDB starting : pid=28932 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:52:46.102+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:52:46.152+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:52:46.570+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507765966:570713][28932:0x7fdc9890fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:52:46.570+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:52:46.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc9783f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC9781E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90205000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC984F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC982F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC97FF8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC97DE3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC97BC6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC9781E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC986FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc9783f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:52:46.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:53:46.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] MongoDB starting : pid=29055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:53:46.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:53:46.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:53:46.816+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766026:816701][29055:0x7fac66c0ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:53:46.816+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:53:46.827+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac65b3e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC65B1D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC667F5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC665F1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC662F7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC660E2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC65EC5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC65B1D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC669FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac65b3e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:53:46.827+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:54:46.949+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] MongoDB starting : pid=29329 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:54:46.956+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:54:47.006+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:54:47.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766087:266645][29329:0x7f891bc18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:54:47.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:54:47.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f891ab48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F891AB27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC447D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F891B7FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F891B5FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F891B301000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F891B0EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F891AECF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F891AB27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F891BA08000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f891ab48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:54:47.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:55:46.407+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] MongoDB starting : pid=29535 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:55:46.414+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:55:46.465+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:55:46.735+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766146:735124][29535:0x7fb909012c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:55:46.735+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:55:46.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb907f42635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB907F21000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB18AA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB908BF9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB9089F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB9086FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB9084E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9082C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB907F21000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB908E02000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb907f42635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:55:46.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:56:46.155+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] MongoDB starting : pid=29768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:56:46.163+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:56:46.214+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:56:46.546+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766206:546134][29768:0x7f5082439c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:56:46.546+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:56:46.556+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5081369635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5081348000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49C85000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5082020000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5081E1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5081B22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F508190D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F50816F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5081348000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5082229000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5081369635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:56:46.556+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:57:46.683+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=29970 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:57:46.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:57:46.739+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:57:47.037+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766267:37981][29970:0x7f0396279c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:57:47.038+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:57:47.048+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f03951a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0395188000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C89C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0395E60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0395C5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0395962000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F039574D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0395530000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0395188000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0396069000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f03951a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:57:47.048+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:58:46.809+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] MongoDB starting : pid=30101 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:58:46.817+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:58:46.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:58:47.251+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766327:251505][30101:0x7f4118a3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:58:47.251+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:58:47.270+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f411796e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F411794D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF34C0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4118625000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4118421000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4118127000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4117F12000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4117CF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F411794D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F411882E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f411796e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:58:47.270+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-11T23:59:46.393+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] MongoDB starting : pid=30363 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] modules: none 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] build environment: 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-11T23:59:46.400+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-11T23:59:46.451+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-11T23:59:46.780+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766386:780518][30363:0x7f2f0e1a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-11T23:59:46.780+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-11T23:59:46.791+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f0d0d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F0D0B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0CA2A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F0DD8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F0DB8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F0D891000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F0D67C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F0D45F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F0D0B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F0DF98000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f0d0d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-11T23:59:46.791+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:00:46.081+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] MongoDB starting : pid=30637 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:00:46.089+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:00:46.152+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:00:46.553+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766446:553026][30637:0x7fd842190c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:00:46.553+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:00:46.572+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8410c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD84109F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF440FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD841D77000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD841B73000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD841879000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD841664000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD841447000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD84109F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD841F80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8410c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:00:46.572+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:01:47.044+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] MongoDB starting : pid=30872 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:01:47.055+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:01:47.109+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:01:47.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766507:416411][30872:0x7fcb20a30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:01:47.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:01:47.426+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb1f960635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB1F93F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4EBD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB20617000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB20413000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB20119000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB1FF04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB1FCE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB1F93F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB20820000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb1f960635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:01:47.426+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:02:46.320+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] MongoDB starting : pid=31563 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:02:46.329+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:02:46.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:02:46.759+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766566:759715][31563:0x7fbf7e8dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:02:46.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:02:46.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbf7d80e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBF7D7ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBF7E4C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBF7E2C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBF7DFC7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBF7DDB2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBF7DB95000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBF7D7ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBF7E6CE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbf7d80e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:02:46.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:03:46.999+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] MongoDB starting : pid=31691 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:03:47.007+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:03:47.060+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:03:47.312+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766627:312296][31691:0x7f5e3bed4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:03:47.312+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:03:47.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e3ae04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E3ADE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E3BABB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E3B8B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E3B5BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E3B3A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E3B18B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E3ADE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E3BCC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e3ae04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:03:47.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:04:46.457+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] MongoDB starting : pid=31965 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:04:46.465+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:04:46.517+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:04:46.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766686:837779][31965:0x7f1dc2acbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:04:46.837+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:04:46.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dc19fb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DC19DA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03C27000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DC26B2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DC24AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DC21B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DC1F9F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DC1D82000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DC19DA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DC28BB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dc19fb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:04:46.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:05:46.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=32184 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:05:47.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:05:47.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:05:47.380+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766747:380525][32184:0x7fec144a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:05:47.380+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:05:47.399+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec133d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC133B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC1408E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC13E8A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC13B90000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC1397B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC1375E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC133B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC14297000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec133d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:05:47.399+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:06:46.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=32419 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:06:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:06:46.891+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:06:46.942+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:06:47.333+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766807:333575][32419:0x7f1dd252dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:06:47.333+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:06:47.358+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dd145d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DD143C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16752000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DD2114000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DD1F10000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DD1C16000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DD1A01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DD17E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DD143C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DD231D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dd145d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:06:47.358+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:07:46.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=32618 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:07:46.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:07:46.545+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:07:46.826+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766866:826718][32618:0x7fdcbaf92c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:07:46.826+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:07:46.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdcb9ec2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCB9EA1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCBAB79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCBA975000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCBA67B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCBA466000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCBA249000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCB9EA1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCBAD82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdcb9ec2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:07:46.837+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:08:46.127+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] MongoDB starting : pid=32742 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:08:46.135+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:08:46.185+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:08:46.591+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766926:591705][32742:0x7f3cc0035c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:08:46.591+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:08:46.611+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3cbef65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3CBEF44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66497000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3CBFC1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3CBFA18000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3CBF71E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3CBF509000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3CBF2EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3CBEF44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3CBFE25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3cbef65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:08:46.611+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:09:46.728+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:09:46.735+0000 I CONTROL [initandlisten] MongoDB starting : pid=535 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:09:46.735+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:09:46.736+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:09:46.785+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:09:47.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507766987:70069][535:0x7f28c637ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:09:47.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:09:47.080+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28c52aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28C5289000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28C5F61000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28C5D5D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28C5A63000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F28C584E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28C5631000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28C5289000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28C616A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28c52aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:09:47.080+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:10:46.216+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] MongoDB starting : pid=761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:10:46.225+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:10:46.275+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:10:46.669+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767046:669058][761:0x7f410d972c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:10:46.669+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:10:46.688+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f410c8a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F410C881000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0795F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F410D559000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F410D355000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F410D05B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F410CE46000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F410CC29000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F410C881000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F410D762000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f410c8a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:10:46.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:11:46.069+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] MongoDB starting : pid=999 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:11:46.076+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:11:46.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:11:46.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767106:409619][999:0x7fcf78465c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:11:46.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:11:46.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf77395635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF77374000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF7804C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF77E48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF77B4E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF77939000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF7771C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF77374000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF78255000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf77395635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:11:46.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:12:46.554+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] MongoDB starting : pid=1275 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:12:46.562+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:12:46.611+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:12:46.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767166:911153][1275:0x7f62fe8d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:12:46.911+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:12:46.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62fd802635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62FD7E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3ED7E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62FE4B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62FE2B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62FDFBB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62FDDA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62FDB89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62FD7E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62FE6C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62fd802635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:12:46.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:13:46.234+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] MongoDB starting : pid=1407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:13:46.241+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:13:46.291+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:13:46.564+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767226:564949][1407:0x7fa360b78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:13:46.565+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:13:46.575+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa35faa8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA35FA87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF328AB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA36075F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA36055B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA360261000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA36004C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA35FE2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA35FA87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA360968000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa35faa8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:13:46.575+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:14:46.698+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] MongoDB starting : pid=1676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:14:46.706+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:14:46.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:14:47.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767287:152207][1676:0x7f2219d90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:14:47.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:14:47.175+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2218cc0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2218C9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF520FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2219977000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2219773000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2219479000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2219264000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2219047000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2218C9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2219B80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2218cc0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:14:47.175+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:15:46.291+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] MongoDB starting : pid=1909 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:15:46.299+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:15:46.355+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:15:46.732+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767346:732229][1909:0x7f6a386c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:15:46.732+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:15:46.743+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a375f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A375D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF048FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A382A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A380A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A37DAA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A37B95000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A37978000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A375D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A384B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a375f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:15:46.743+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:16:46.104+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] MongoDB starting : pid=2066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:16:46.112+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:16:46.164+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:16:46.483+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767406:483364][2066:0x7f9d689c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:16:46.483+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:16:46.503+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d678f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D678CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C5AC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D685A7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D683A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D680A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D67E94000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D67C77000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D678CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D687B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d678f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:16:46.503+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:17:46.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] MongoDB starting : pid=2280 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:17:46.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:17:46.688+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:17:46.968+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767466:968309][2280:0x7f67f8629c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:17:46.968+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:17:46.979+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67f7559635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67F7538000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67F8210000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67F800C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67F7D12000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67F7AFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67F78E0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67F7538000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67F8419000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67f7559635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:17:46.979+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:18:46.476+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] MongoDB starting : pid=2488 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:18:46.485+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:18:46.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:18:46.842+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767526:842884][2488:0x7f36f10d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:18:46.842+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:18:46.853+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36f0001635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36EFFE0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36F0CB8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36F0AB4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36F07BA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36F05A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36F0388000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36EFFE0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36F0EC1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36f0001635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:18:46.853+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:19:46.978+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] MongoDB starting : pid=2616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:19:46.987+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:19:47.038+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:19:47.328+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767587:328652][2616:0x7fb74a965c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:19:47.328+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:19:47.339+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb749895635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB749874000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB74A54C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB74A348000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB74A04E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB749E39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB749C1C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB749874000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB74A755000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb749895635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:19:47.339+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:20:46.469+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=2889 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:20:46.477+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:20:46.528+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:20:46.859+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767646:859750][2889:0x7fe2e245dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:20:46.859+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:20:46.880+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2e138d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2E136C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64EC8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2E2044000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2E1E40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2E1B46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2E1931000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2E1714000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2E136C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2E224D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2e138d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:20:46.880+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:21:46.306+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] MongoDB starting : pid=3123 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:21:46.314+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:21:46.364+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:21:46.680+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767706:680020][3123:0x7faf4a2b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:21:46.680+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:21:46.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf491e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF491C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FCA7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF49E9C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF49C98000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF4999E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF49789000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF4956C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF491C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF4A0A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf491e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:21:46.690+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:22:46.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] MongoDB starting : pid=3327 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:22:46.832+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:22:46.884+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:22:47.281+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767767:281951][3327:0x7f0a6476ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:22:47.282+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:22:47.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a6369e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A6367D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF45AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A64355000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A64151000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A63E57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A63C42000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A63A25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A6367D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A6455E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a6369e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:22:47.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:23:46.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=3544 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:23:46.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:23:46.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:23:47.227+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767827:226992][3544:0x7fba92e1fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:23:47.227+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:23:47.237+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba91d4f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA91D2E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE1A7A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA92A06000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA92802000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA92508000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA922F3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA920D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA91D2E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA92C0F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba91d4f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:23:47.237+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:24:46.363+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] MongoDB starting : pid=3674 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:24:46.371+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:24:46.422+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:24:46.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767886:751107][3674:0x7f04b3f10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:24:46.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:24:46.761+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04b2e40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04B2E1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04B3AF7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04B38F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04B35F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04B33E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04B31C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04B2E1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04B3D00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04b2e40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:24:46.761+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:25:46.880+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] MongoDB starting : pid=3947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:25:46.887+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:25:46.888+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:25:46.937+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:25:47.212+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507767947:212871][3947:0x7f9fc0e25c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:25:47.212+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:25:47.223+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9fbfd55635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9FBFD34000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF54FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9FC0A0C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9FC0808000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9FC050E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9FC02F9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9FC00DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9FBFD34000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9FC0C15000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9fbfd55635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:25:47.223+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:26:46.689+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] MongoDB starting : pid=4182 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:26:46.697+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:26:46.746+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:26:47.055+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768007:55981][4182:0x7fc4b86cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:26:47.056+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:26:47.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4b75fd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4B75DC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF380A6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4B82B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4B80B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4B7DB6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4B7BA1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4B7984000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4B75DC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4B84BD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4b75fd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:26:47.066+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:27:46.193+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] MongoDB starting : pid=4378 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:27:46.201+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:27:46.261+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:27:46.563+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768066:563983][4378:0x7f4fa31cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:27:46.564+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:27:46.574+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4fa20fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4FA20DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF46E82000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4FA2DB5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4FA2BB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4FA28B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4FA26A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4FA2485000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4FA20DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4FA2FBE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4fa20fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:27:46.574+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:28:47.000+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] MongoDB starting : pid=4606 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:28:47.008+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:28:47.061+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:28:47.401+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768127:401756][4606:0x7fc282a31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:28:47.401+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:28:47.413+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc281961635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC281940000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF966FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC282618000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC282414000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC28211A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC281F05000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC281CE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC281940000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC282821000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc281961635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:28:47.413+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:29:46.546+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] MongoDB starting : pid=4731 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:29:46.554+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:29:46.605+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:29:46.928+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768186:928268][4731:0x7fda8c2dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:29:46.928+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:29:46.947+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda8b20f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA8B1EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFC01000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA8BEC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA8BCC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA8B9C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA8B7B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA8B596000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA8B1EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA8C0CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda8b20f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:29:46.947+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:30:46.066+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=5194 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:30:46.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:30:46.123+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:30:46.430+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768246:430855][5194:0x7f6489387c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:30:46.430+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:30:46.441+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f64882b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6488296000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA290000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6488F6E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6488D6A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6488A70000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F648885B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F648863E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6488296000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6489177000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f64882b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:30:46.441+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:31:46.844+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] MongoDB starting : pid=5567 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:31:46.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:31:46.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:31:47.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768307:261132][5567:0x7fab1bcb7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:31:47.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:31:47.271+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fab1abe7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAB1ABC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36B7B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAB1B89E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB1B69A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB1B3A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB1B18B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB1AF6E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB1ABC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB1BAA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fab1abe7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:31:47.271+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:32:46.385+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:32:46.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=5917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:32:46.392+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:32:46.392+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:32:46.392+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:32:46.392+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:32:46.393+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:32:46.393+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:32:46.393+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:32:46.393+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:32:46.443+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:32:46.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768366:775517][5917:0x7f36b7ea9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:32:46.775+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:32:46.795+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36b6dd9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36B6DB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD0A6C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36B7A90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36B788C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36B7592000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36B737D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36B7160000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36B6DB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36B7C99000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36b6dd9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:32:46.795+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:33:46.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] MongoDB starting : pid=6250 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:33:46.291+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:33:46.342+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:33:46.629+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768426:629556][6250:0x7f131ba98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:33:46.629+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:33:46.649+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f131a9c8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F131A9A7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "800000588000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F131B67F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F131B47B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F131B181000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F131AF6C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F131AD4F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F131A9A7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F131B888000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f131a9c8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:33:46.649+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:34:46.777+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] MongoDB starting : pid=6442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:34:46.785+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:34:46.834+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:34:47.109+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768487:109064][6442:0x7fead8084c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:34:47.109+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:34:47.119+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fead6fb4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEAD6F93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF14F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEAD7C6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEAD7A67000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEAD776D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEAD7558000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEAD733B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEAD6F93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEAD7E74000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fead6fb4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:34:47.119+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:35:46.250+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] MongoDB starting : pid=6762 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:35:46.258+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:35:46.307+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:35:46.649+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768546:649396][6762:0x7fc4c2d4cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:35:46.649+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:35:46.659+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4c1c7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4C1C5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0EA63000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4C2933000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4C272F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4C2435000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4C2220000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4C2003000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4C1C5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4C2B3C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4c1c7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:35:46.660+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:36:46.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] MongoDB starting : pid=7000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:36:46.081+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:36:46.131+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:36:46.452+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768606:452874][7000:0x7f6b1985bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:36:46.452+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:36:46.473+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b1878b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B1876A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3501D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B19442000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B1923E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B18F44000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B18D2F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B18B12000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B1876A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B1964B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b1878b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:36:46.473+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:37:46.612+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=7201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:37:46.622+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:37:46.675+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:37:46.972+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768666:972252][7201:0x7f440d4b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:37:46.972+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:37:46.983+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f440c3eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F440C3CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F440DDCA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F440D0A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F440CE9E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F440CBA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F440C98F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F440C772000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F440C3CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F440D2AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f440c3eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:37:46.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:38:46.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] MongoDB starting : pid=7408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:38:46.493+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:38:46.544+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:38:46.897+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768726:897200][7408:0x7ffca43bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:38:46.897+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:38:46.916+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffca32ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFCA32CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFCA3FA3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFCA3D9F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFCA3AA5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFCA3890000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFCA3673000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFCA32CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFCA41AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffca32ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:38:46.916+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:39:47.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=7533 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:39:47.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:39:47.100+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:39:47.438+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768787:438740][7533:0x7fb2dd20ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:39:47.438+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:39:47.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb2dc13a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB2DC119000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5889B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB2DCDF1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB2DCBED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB2DC8F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB2DC6DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB2DC4C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB2DC119000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB2DCFFA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb2dc13a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:39:47.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:40:46.579+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] MongoDB starting : pid=7804 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:40:46.587+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:40:46.636+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:40:46.939+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768846:939291][7804:0x7f4934ea8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:40:46.939+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:40:46.949+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4933dd8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4933DB7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA72FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4934A8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F493488B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4934591000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F493437C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F493415F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4933DB7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4934C98000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4933dd8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:40:46.949+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:41:46.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] MongoDB starting : pid=8042 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:41:46.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:41:46.468+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:41:46.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768906:841631][8042:0x7f741d105c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:41:46.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:41:46.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f741c035635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F741C014000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F741CCEC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F741CAE8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F741C7EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F741C5D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F741C3BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F741C014000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F741CEF5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f741c035635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:41:46.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:42:46.972+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] MongoDB starting : pid=8253 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:42:46.980+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:42:47.029+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:42:47.350+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507768967:350925][8253:0x7fd3a0b08c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:42:47.350+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:42:47.361+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd39fa38635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD39FA17000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3A06EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3A04EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3A01F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD39FFDC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD39FDBF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD39FA17000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3A08F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd39fa38635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:42:47.361+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:43:46.559+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] MongoDB starting : pid=8474 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:43:46.567+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:43:46.620+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:43:46.885+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769026:885816][8474:0x7f2462acfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:43:46.885+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:43:46.896+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24619ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24619DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F24626B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F24624B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F24621B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2461FA3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2461D86000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24619DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24628BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24619ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:43:46.896+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:44:47.021+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] MongoDB starting : pid=8625 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:44:47.029+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:44:47.079+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:44:47.413+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769087:413600][8625:0x7fb1edcdbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:44:47.413+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:44:47.424+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb1ecc0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1ECBEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB1ED8C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1ED6BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB1ED3C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB1ED1AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1ECF92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1ECBEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB1EDACB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb1ecc0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:44:47.424+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:45:46.559+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] MongoDB starting : pid=8895 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:45:46.566+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:45:46.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:45:46.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769146:896075][8895:0x7f97111e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:45:46.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:45:46.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9710119635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F97100F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9710DD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9710BCC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F97108D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F97106BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F97104A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F97100F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9710FD9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9710119635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:45:46.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:46:46.282+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] MongoDB starting : pid=9129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:46:46.290+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:46:46.339+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:46:46.619+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769206:619728][9129:0x7f0fb9627c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:46:46.619+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:46:46.630+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fb8557635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FB8536000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70EA0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FB920E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FB900A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FB8D10000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FB8AFB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FB88DE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FB8536000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FB9417000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fb8557635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:46:46.630+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:47:46.755+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] MongoDB starting : pid=9326 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:47:46.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:47:46.814+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:47:47.198+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769267:198648][9326:0x7f58b946ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:47:47.198+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:47:47.218+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58b839a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58B8379000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE4D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58B9051000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58B8E4D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58B8B53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58B893E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58B8721000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58B8379000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58B925A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58b839a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:47:47.218+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:48:47.015+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] MongoDB starting : pid=9536 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:48:47.024+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:48:47.075+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:48:47.449+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769327:449831][9536:0x7f4e2d165c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:48:47.449+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:48:47.469+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e2c095635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E2C074000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF06FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E2CD4C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E2CB48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E2C84E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E2C639000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E2C41C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E2C074000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E2CF55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e2c095635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:48:47.469+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:49:46.590+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=9662 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:49:46.598+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:49:46.648+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:49:47.000+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769387:693][9662:0x7fe64a45ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:49:47.000+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:49:47.011+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe64938a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE649369000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE64A041000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE649E3D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE649B43000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE64992E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE649711000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE649369000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE64A24A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe64938a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:49:47.011+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:50:46.140+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] MongoDB starting : pid=9929 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:50:46.147+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:50:46.197+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:50:46.581+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769446:581646][9929:0x7f7062af4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:50:46.581+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:50:46.601+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7061a24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7061A03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F70626DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F70624D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F70621DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7061FC8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7061DAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7061A03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F70628E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7061a24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:50:46.601+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:51:46.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] MongoDB starting : pid=10153 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:51:47.004+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:51:47.059+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:51:47.447+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769507:447890][10153:0x7f9b0e6f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:51:47.447+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:51:47.467+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b0d622635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B0D601000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00966000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B0E2D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B0E0D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B0DDDB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B0DBC6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B0D9A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B0D601000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B0E4E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b0d622635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:51:47.467+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:52:46.601+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] MongoDB starting : pid=10282 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:52:46.609+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:52:46.659+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:52:46.946+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769566:946641][10282:0x7f0b8db0dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:52:46.946+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:52:46.958+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0b8ca3d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0B8CA1C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF254FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0B8D6F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0B8D4F0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0B8D1F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0B8CFE1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0B8CDC4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0B8CA1C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0B8D8FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0b8ca3d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:52:46.958+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:53:46.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] MongoDB starting : pid=10490 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:53:46.098+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:53:46.148+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:53:46.530+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769626:530803][10490:0x7fcf2821cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:53:46.530+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:53:46.550+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf2714c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF2712B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88DCF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF27E03000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF27BFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF27905000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF276F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF274D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF2712B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF2800C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf2714c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:53:46.550+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:54:46.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=10707 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:54:46.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:54:46.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:54:47.034+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769687:34142][10707:0x7f32e822bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:54:47.034+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:54:47.054+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32e715b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F32E713A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F32E7E12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F32E7C0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F32E7914000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F32E76FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F32E74E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F32E713A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F32E801B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32e715b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:54:47.054+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:55:46.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=10849 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:55:46.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:55:46.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:55:46.601+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769746:601008][10849:0x7f820f996c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:55:46.601+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:55:46.620+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f820e8c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F820E8A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEBEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F820F57D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F820F379000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F820F07F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F820EE6A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F820EC4D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F820E8A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F820F786000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f820e8c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:55:46.620+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:56:47.026+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] MongoDB starting : pid=11142 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:56:47.034+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:56:47.084+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:56:47.477+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769807:477714][11142:0x7f7994f40c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:56:47.477+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:56:47.497+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7993e70635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7993E4F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF318FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7994B27000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7994923000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7994629000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7994414000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79941F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7993E4F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7994D30000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7993e70635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:56:47.497+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:57:46.615+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] MongoDB starting : pid=11339 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:57:46.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:57:46.674+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:57:47.082+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769867:82335][11339:0x7f3d4ed38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:57:47.082+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:57:47.102+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d4dc68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D4DC47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2C69000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D4E91F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D4E71B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D4E421000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D4E20C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D4DFEF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D4DC47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D4EB28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d4dc68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:57:47.102+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:58:46.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=11595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:58:46.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:58:46.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:58:46.585+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769926:585583][11595:0x7f5aa4c1ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:58:46.585+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:58:46.596+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5aa3b4a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AA3B29000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AA4801000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AA45FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AA4303000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AA40EE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AA3ED1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AA3B29000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AA4A0A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5aa3b4a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:58:46.596+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T00:59:46.728+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T00:59:46.735+0000 I CONTROL [initandlisten] MongoDB starting : pid=11812 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] modules: none 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] build environment: 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T00:59:46.736+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T00:59:46.787+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T00:59:47.103+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507769987:103058][11812:0x7f0c607e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T00:59:47.103+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T00:59:47.113+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c5f710635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C5F6EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA9E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C603C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C601C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C5FEC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C5FCB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C5FA97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C5F6EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C605D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c5f710635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T00:59:47.113+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:00:46.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] MongoDB starting : pid=11948 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:00:46.239+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:00:46.289+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:00:46.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770046:670771][11948:0x7fbdb04acc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:00:46.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:00:46.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbdaf3dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBDAF3BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBDB0093000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBDAFE8F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBDAFB95000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBDAF980000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBDAF763000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBDAF3BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBDB029C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbdaf3dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:00:46.690+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:01:46.138+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] MongoDB starting : pid=12239 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:01:46.145+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:01:46.196+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:01:46.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770106:561784][12239:0x7fc8ccb33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:01:46.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:01:46.583+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8cba63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8CBA42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFC0BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8CC71A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8CC516000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8CC21C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8CC007000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8CBDEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8CBA42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8CC923000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8cba63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:01:46.583+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:02:46.362+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] MongoDB starting : pid=12443 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:02:46.370+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:02:46.420+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:02:46.769+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770166:769173][12443:0x7f5e7a21bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:02:46.769+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:02:46.779+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e7914b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E7912A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FA28000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E79E02000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E79BFE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E79904000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E796EF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E794D2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E7912A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E7A00B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e7914b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:02:46.779+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:03:46.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] MongoDB starting : pid=12654 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:03:46.490+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:03:46.541+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:03:46.948+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770226:948422][12654:0x7f909a759c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:03:46.948+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:03:46.968+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9099689635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9099668000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC079000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F909A340000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F909A13C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9099E42000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9099C2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9099A10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9099668000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F909A549000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9099689635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:03:46.968+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:04:46.097+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=12868 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:04:46.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:04:46.155+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:04:46.466+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770286:466817][12868:0x7ff782aacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:04:46.466+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:04:46.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff7819dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF7819BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF782693000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF78248F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF782195000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF781F80000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF781D63000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF7819BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF78289C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff7819dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:04:46.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:05:46.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] MongoDB starting : pid=13005 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:05:46.607+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:05:46.657+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:05:46.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770346:910908][13005:0x7fb9243adc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:05:46.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:05:46.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb9232dd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB9232BC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF22BAC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB923F94000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB923D90000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB923A96000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB923881000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB923664000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB9232BC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB92419D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb9232dd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:05:46.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:06:46.387+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] MongoDB starting : pid=13292 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:06:46.395+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:06:46.445+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:06:46.858+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770406:858159][13292:0x7f74449f8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:06:46.858+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:06:46.878+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7443928635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7443907000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F07E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74445DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74443DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74440E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7443ECC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7443CAF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7443907000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74447E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7443928635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:06:46.878+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:07:47.013+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] MongoDB starting : pid=13490 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:07:47.021+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:07:47.073+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:07:47.461+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770467:461790][13490:0x7f439bf54c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:07:47.461+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:07:47.481+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f439ae84635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F439AE63000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F439BB3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F439B937000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F439B63D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F439B428000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F439B20B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F439AE63000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F439BD44000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f439ae84635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:07:47.482+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:08:46.893+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=13708 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:08:46.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:08:46.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:08:47.312+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770527:312439][13708:0x7fab21c28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:08:47.312+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:08:47.323+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fab20b58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAB20B37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF512FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAB2180F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB2160B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB21311000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB210FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB20EDF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB20B37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB21A18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fab20b58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:08:47.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:09:46.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] MongoDB starting : pid=13917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:09:46.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:09:46.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:09:46.827+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770586:827921][13917:0x7f6ff98fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:09:46.827+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:09:46.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6ff882b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6FF880A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6FF94E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6FF92DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6FF8FE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6FF8DCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6FF8BB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6FF880A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6FF96EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6ff882b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:09:46.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:10:46.965+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] MongoDB starting : pid=14054 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:10:46.973+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:10:47.022+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:10:47.365+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770647:365506][14054:0x7f56a1942c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:10:47.365+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:10:47.386+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56a0872635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56A0851000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56A1529000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56A1325000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56A102B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56A0E16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56A0BF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56A0851000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56A1732000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56a0872635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:10:47.386+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:11:46.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=14347 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:11:46.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:11:46.957+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:11:47.330+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770707:330672][14347:0x7fc67f7d5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:11:47.330+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:11:47.350+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc67e705635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC67E6E4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC67F3BC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC67F1B8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC67EEBE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC67ECA9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC67EA8C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC67E6E4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC67F5C5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc67e705635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:11:47.350+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:12:46.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] MongoDB starting : pid=14883 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:12:46.486+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:12:46.537+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:12:46.854+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770766:854197][14883:0x7f3248a39c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:12:46.854+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:12:46.865+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3247969635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3247948000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF778FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3248620000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F324841C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3248122000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3247F0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3247CF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3247948000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3248829000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3247969635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:12:46.865+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:13:46.957+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] MongoDB starting : pid=15131 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:13:46.966+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:13:47.017+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:13:47.352+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770827:352356][15131:0x7f44f3bfec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:13:47.352+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:13:47.372+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44f2b2e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44F2B0D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44F37E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44F35E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44F32E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44F30D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44F2EB5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44F2B0D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44F39EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44f2b2e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:13:47.372+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:14:46.502+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] MongoDB starting : pid=15348 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:14:46.509+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:14:46.562+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:14:46.879+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770886:879548][15348:0x7f68c6436c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:14:46.879+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:14:46.890+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68c5366635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68C5345000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32AC2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68C601D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68C5E19000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68C5B1F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68C590A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68C56ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68C5345000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68C6226000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68c5366635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:14:46.890+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:15:47.020+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] MongoDB starting : pid=15492 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:15:47.028+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:15:47.079+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:15:47.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507770947:410952][15492:0x7f6961529c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:15:47.411+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:15:47.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6960459635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6960438000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA97EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6961110000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6960F0C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6960C12000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F69609FD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F69607E0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6960438000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6961319000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6960459635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:15:47.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:16:46.829+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] MongoDB starting : pid=15778 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:16:46.836+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:16:46.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:16:47.232+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771007:232433][15778:0x7f9fedb2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:16:47.232+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:16:47.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9feca5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9FECA3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF29BCC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9FED713000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9FED50F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9FED215000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9FED000000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9FECDE3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9FECA3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9FED91C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9feca5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:16:47.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:17:46.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] MongoDB starting : pid=15985 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:17:46.383+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:17:46.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:17:46.750+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771066:750940][15985:0x7f04421abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:17:46.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:17:46.761+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04410db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04410BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF808FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0441D92000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0441B8E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0441894000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F044167F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0441462000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04410BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0441F9B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04410db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:17:46.761+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:18:46.095+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] MongoDB starting : pid=16195 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:18:46.103+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:18:46.154+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:18:46.448+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771126:448043][16195:0x7f1159ddbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:18:46.448+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:18:46.472+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1158d0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1158CEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF926FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F11599C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F11597BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F11594C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F11592AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1159092000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1158CEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1159BCB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1158d0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:18:46.473+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:19:46.601+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] MongoDB starting : pid=16402 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:19:46.613+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:19:46.668+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:19:46.984+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771186:984049][16402:0x7f0296f7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:19:46.984+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:19:46.995+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0295ead635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0295E8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF212FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0296B64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0296960000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0296666000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0296451000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0296234000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0295E8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0296D6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0295ead635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:19:46.995+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:20:46.134+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] MongoDB starting : pid=16547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:20:46.142+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:20:46.192+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:20:46.502+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771246:502576][16547:0x7f4fcab84c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:20:46.502+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:20:46.522+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4fc9ab4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4FC9A93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF706FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4FCA76B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4FCA567000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4FCA26D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4FCA058000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4FC9E3B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4FC9A93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4FCA974000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4fc9ab4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:20:46.522+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:21:46.996+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] MongoDB starting : pid=16843 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:21:47.004+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:21:47.054+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:21:47.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771307:440408][16843:0x7f16a2537c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:21:47.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:21:47.461+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16a1467635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16A1446000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13BA7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F16A211E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F16A1F1A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F16A1C20000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F16A1A0B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F16A17EE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16A1446000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F16A2327000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16a1467635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:21:47.461+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:22:46.585+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] MongoDB starting : pid=17043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:22:46.593+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:22:46.643+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:22:46.899+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771366:899611][17043:0x7f0029977c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:22:46.899+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:22:46.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00288a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0028886000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EA74000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F002955E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F002935A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0029060000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0028E4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0028C2E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0028886000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0029767000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00288a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:22:46.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:23:46.385+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] MongoDB starting : pid=17251 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:23:46.393+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:23:46.442+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:23:46.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771426:783025][17251:0x7f8fa5e17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:23:46.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:23:46.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8fa4d47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8FA4D26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF588FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8FA59FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8FA57FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8FA5500000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8FA52EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8FA50CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8FA4D26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8FA5C07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8fa4d47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:23:46.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:24:46.923+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] MongoDB starting : pid=17459 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:24:46.930+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:24:46.980+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:24:47.270+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771487:270120][17459:0x7ffe893d4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:24:47.270+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:24:47.280+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe88304635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE882E3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF34CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE88FBB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE88DB7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE88ABD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE888A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE8868B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE882E3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE891C4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe88304635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:24:47.280+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:25:46.409+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] MongoDB starting : pid=17601 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:25:46.420+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:25:46.474+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:25:46.858+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771546:858389][17601:0x7f91fb951c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:25:46.858+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:25:46.878+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91fa881635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91FA860000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF814FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F91FB538000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F91FB334000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F91FB03A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F91FAE25000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F91FAC08000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91FA860000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91FB741000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91fa881635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:25:46.878+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:26:46.347+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] MongoDB starting : pid=17866 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:26:46.355+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:26:46.356+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:26:46.356+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:26:46.406+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:26:46.712+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771606:712137][17866:0x7f17af9e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:26:46.712+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:26:46.731+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f17ae910635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F17AE8EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14CB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F17AF5C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17AF3C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17AF0C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17AEEB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17AEC97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F17AE8EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F17AF7D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f17ae910635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:26:46.731+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:27:46.859+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] MongoDB starting : pid=18000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:27:46.867+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:27:46.918+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:27:47.246+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771667:246800][18000:0x7f21d6dcfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:27:47.246+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:27:47.258+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21d5cff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21D5CDE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF46FFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21D69B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21D67B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F21D64B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F21D62A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21D6086000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21D5CDE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21D6BBF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21d5cff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:27:47.258+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:28:46.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=18217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:28:46.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:28:46.439+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:28:46.729+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771726:729352][18217:0x7f6e3f8b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:28:46.729+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:28:46.739+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e3e7e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E3E7C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEE92000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E3F49F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E3F29B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E3EFA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E3ED8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E3EB6F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E3E7C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E3F6A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e3e7e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:28:46.739+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:29:46.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=18417 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:29:46.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:29:47.044+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:29:47.310+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771787:310373][18417:0x7f0683aa9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:29:47.310+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:29:47.320+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f06829d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F06829B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0683690000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F068348C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0683192000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0682F7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0682D60000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F06829B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0683899000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f06829d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:29:47.320+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:30:46.453+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:30:46.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=18653 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:30:46.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:30:46.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:30:46.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:30:46.461+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:30:46.461+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:30:46.461+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:30:46.461+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:30:46.461+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:30:46.511+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:30:46.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771846:795925][18653:0x7f9450744c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:30:46.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:30:46.806+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f944f674635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F944F653000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF78A61000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F945032B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9450127000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F944FE2D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F944FC18000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F944F9FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F944F653000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9450534000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f944f674635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:30:46.806+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:31:46.288+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] MongoDB starting : pid=18801 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:31:46.295+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:31:46.296+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:31:46.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:31:46.766+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771906:766292][18801:0x7fee4fabbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:31:46.766+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:31:46.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee4e9eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE4E9CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD86D2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE4F6A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE4F49E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE4F1A4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE4EF8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE4ED72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE4E9CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE4F8AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee4e9eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:31:46.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:32:46.913+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] MongoDB starting : pid=19057 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:32:46.921+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:32:46.970+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:32:47.268+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507771967:268603][19057:0x7f963590fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:32:47.268+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:32:47.279+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f963483f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F963481E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96354F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96352F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9634FF8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9634DE3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9634BC6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F963481E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96356FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f963483f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:32:47.279+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:33:46.398+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=19264 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:33:46.406+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:33:46.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:33:46.721+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772026:721387][19264:0x7fb655ec0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:33:46.721+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:33:46.731+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb654df0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB654DCF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB655AA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB6558A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB6555A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB655394000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB655177000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB654DCF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB655CB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb654df0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:33:46.731+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:34:46.343+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:34:46.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=19471 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:34:46.353+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:34:46.403+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:34:46.708+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772086:708473][19471:0x7f619137ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:34:46.708+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:34:46.719+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61902ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F619028D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF4B4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6190F65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6190D61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6190A67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6190852000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6190635000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F619028D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F619116E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61902ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:34:46.719+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:35:46.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=19703 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:35:46.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:35:46.903+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:35:47.281+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772147:281045][19703:0x7f9fcfb4cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:35:47.281+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:35:47.300+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9fcea7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9FCEA5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6787E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9FCF733000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9FCF52F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9FCF235000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9FCF020000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9FCEE03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9FCEA5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9FCF93C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9fcea7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:35:47.300+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:36:46.758+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] MongoDB starting : pid=19852 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:36:46.766+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:36:46.767+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:36:46.816+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:36:47.136+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772207:136126][19852:0x7fa21155fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:36:47.136+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:36:47.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa21048f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA21046E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF505CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA211146000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA210F42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA210C48000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA210A33000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA210816000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA21046E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA21134F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa21048f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:36:47.147+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:37:46.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] MongoDB starting : pid=20106 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:37:46.291+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:37:46.342+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:37:46.718+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772266:718068][20106:0x7f6efcbf7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:37:46.718+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:37:46.738+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6efbb27635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6EFBB06000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA561E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6EFC7DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6EFC5DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6EFC2E0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6EFC0CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6EFBEAE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6EFBB06000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6EFC9E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6efbb27635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:37:46.738+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:38:46.881+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] MongoDB starting : pid=20317 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:38:46.889+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:38:46.939+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:38:47.221+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772327:221191][20317:0x7eff07e2ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:38:47.221+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:38:47.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff06d5a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF06D39000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6212000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF07A11000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF0780D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF07513000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF072FE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF070E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF06D39000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF07C1A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff06d5a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:38:47.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:39:46.838+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] MongoDB starting : pid=20519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:39:46.846+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:39:46.896+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:39:47.179+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772387:179619][20519:0x7f7d4fc16c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:39:47.179+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:39:47.190+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d4eb46635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D4EB25000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42ACE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D4F7FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D4F5F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D4F2FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D4F0EA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D4EECD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D4EB25000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D4FA06000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d4eb46635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:39:47.190+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:40:46.322+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=20751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:40:46.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:40:46.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:40:46.663+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772446:663253][20751:0x7f92c1c6cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:40:46.663+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:40:46.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f92c0b9c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F92C0B7B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5AC3A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F92C1853000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F92C164F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F92C1355000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F92C1140000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F92C0F23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F92C0B7B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F92C1A5C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f92c0b9c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:40:46.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:41:46.084+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] MongoDB starting : pid=20928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:41:46.092+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:41:46.145+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:41:46.432+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772506:432003][20928:0x7fa5f26d3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:41:46.432+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:41:46.442+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5f1603635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5F15E2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B1A1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5F22BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5F20B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5F1DBC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5F1BA7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5F198A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5F15E2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5F24C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5f1603635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:41:46.442+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:42:46.568+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:42:46.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=21185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:42:46.579+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:42:46.633+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:42:46.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772566:894127][21185:0x7fb7fefd0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:42:46.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:42:46.907+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb7fdf00635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB7FDEDF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF814DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB7FEBB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB7FE9B3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB7FE6B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB7FE4A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB7FE287000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB7FDEDF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB7FEDC0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb7fdf00635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:42:46.907+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:43:47.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=21407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:43:47.049+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:43:47.098+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:43:47.439+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772627:439532][21407:0x7f3e13c5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:43:47.439+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:43:47.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e12b8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E12B6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF42FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E13846000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E13642000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E13348000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E13133000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E12F16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E12B6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E13A4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e12b8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:43:47.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:44:46.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=21606 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:44:46.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:44:46.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:44:46.752+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772686:752384][21606:0x7f8ec8eb4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:44:46.752+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:44:46.762+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ec7de4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EC7DC3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF4CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EC8A9B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EC8897000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EC859D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EC8388000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EC816B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EC7DC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EC8CA4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ec7de4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:44:46.762+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:45:46.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:45:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=21842 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:45:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:45:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:45:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:45:46.891+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:45:46.891+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:45:46.891+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:45:46.891+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:45:46.891+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:45:46.941+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:45:47.244+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772747:244854][21842:0x7f2932342c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:45:47.244+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:45:47.255+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2931272635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2931251000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2931F29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2931D25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2931A2B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2931816000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29315F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2931251000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2932132000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2931272635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:45:47.255+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:46:46.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=21995 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:46:46.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:46:46.773+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:46:47.127+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772807:127224][21995:0x7fed0030dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:46:47.127+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:46:47.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fecff23d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECFF21C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2CC66000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECFFEF4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECFFCF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECFF9F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECFF7E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECFF5C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECFF21C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED000FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fecff23d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:46:47.147+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:47:46.263+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] MongoDB starting : pid=22254 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:47:46.271+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:47:46.321+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:47:46.613+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772866:613600][22254:0x7f78fe12bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:47:46.613+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:47:46.624+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78fd05b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78FD03A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48EF5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78FDD12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78FDB0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78FD814000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78FD5FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78FD3E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78FD03A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78FDF1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78fd05b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:47:46.624+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:48:46.755+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] MongoDB starting : pid=22469 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:48:46.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:48:46.815+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:48:47.221+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772927:221052][22469:0x7f5f1d054c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:48:47.221+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:48:47.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5f1bf84635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5F1BF63000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF394FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5F1CC3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5F1CA37000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5F1C73D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5F1C528000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5F1C30B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5F1BF63000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5F1CE44000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5f1bf84635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:48:47.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:49:46.805+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] MongoDB starting : pid=22666 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:49:46.817+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:49:46.870+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:49:47.262+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507772987:262465][22666:0x7ff3cb13cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:49:47.262+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:49:47.282+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3ca06c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3CA04B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF73E71000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3CAD23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3CAB1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3CA825000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3CA610000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3CA3F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3CA04B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3CAF2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3ca06c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:49:47.282+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:50:46.408+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] MongoDB starting : pid=22900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:50:46.416+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:50:46.466+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:50:46.728+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773046:728027][22900:0x7fdb9aa9ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:50:46.728+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:50:46.738+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb999ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB999AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8EA4E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB9A685000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB9A481000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB9A187000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB99F72000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB99D55000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB999AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB9A88E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb999ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:50:46.738+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:51:46.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=23052 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:51:46.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:51:46.257+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:51:46.623+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773106:623763][23052:0x7fa6aa8d3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:51:46.623+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:51:46.634+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6a9803635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6A97E2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6AA4BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6AA2B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6A9FBC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6A9DA7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6A9B8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6A97E2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6AA6C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6a9803635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:51:46.634+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:52:46.757+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] MongoDB starting : pid=23307 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:52:46.765+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:52:46.815+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:52:47.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773167:161560][23307:0x7f4f66d63c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:52:47.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:52:47.174+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4f65c93635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4F65C72000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BFE8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4F6694A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4F66746000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4F6644C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4F66237000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4F6601A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4F65C72000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4F66B53000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4f65c93635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:52:47.174+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:53:46.297+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=23516 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:53:46.305+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:53:46.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:53:46.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773226:661967][23516:0x7fda8c6f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:53:46.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:53:46.672+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda8b623635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA8B602000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF47CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA8C2DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA8C0D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA8BDDC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA8BBC7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA8B9AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA8B602000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA8C4E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda8b623635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:53:46.672+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:54:46.222+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] MongoDB starting : pid=23723 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:54:46.230+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:54:46.279+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:54:46.672+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773286:672681][23723:0x7f98daee2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:54:46.672+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:54:46.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98d9e12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98D9DF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98DAAC9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98DA8C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98DA5CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98DA3B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98DA199000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98D9DF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98DACD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98d9e12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:54:46.692+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:55:46.810+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=23953 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:55:46.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:55:46.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:55:47.176+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773347:176229][23953:0x7fb8e1fe3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:55:47.176+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:55:47.186+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb8e0f13635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB8E0EF2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24676000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB8E1BCA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB8E19C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB8E16CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB8E14B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB8E129A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB8E0EF2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB8E1DD3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb8e0f13635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:55:47.186+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:56:46.579+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:56:46.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=24104 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:56:46.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:56:46.591+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:56:46.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:56:46.958+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773406:958357][24104:0x7f4baf53bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:56:46.958+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:56:46.978+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4bae46b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4BAE44A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA6E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4BAF122000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4BAEF1E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4BAEC24000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4BAEA0F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4BAE7F2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4BAE44A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4BAF32B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4bae46b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:56:46.978+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:57:46.119+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] MongoDB starting : pid=24354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:57:46.127+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:57:46.179+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:57:46.541+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773466:541951][24354:0x7f2840812c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:57:46.542+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:57:46.555+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f283f742635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F283F721000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28403F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28401F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F283FEFB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F283FCE6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F283FAC9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F283F721000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2840602000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f283f742635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:57:46.555+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:58:46.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=24574 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:58:46.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:58:46.739+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:58:47.057+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773527:57217][24574:0x7f3ddfac1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:58:47.057+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:58:47.068+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3dde9f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DDE9D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF29C8B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DDF6A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DDF4A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DDF1AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DDEF95000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DDED78000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DDE9D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DDF8B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3dde9f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:58:47.068+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T01:59:46.464+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] MongoDB starting : pid=24783 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] modules: none 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] build environment: 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T01:59:46.472+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T01:59:46.522+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T01:59:46.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773586:910722][24783:0x7f9a83561c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T01:59:46.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T01:59:46.925+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a82491635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A82470000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF877BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A83148000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A82F44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A82C4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A82A35000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A82818000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A82470000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A83351000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a82491635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T01:59:46.925+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:00:47.050+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] MongoDB starting : pid=25022 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:00:47.058+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:00:47.108+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:00:47.432+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773647:432915][25022:0x7f41891d3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:00:47.432+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:00:47.444+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4188103635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41880E2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4188DBA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4188BB6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41888BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F41886A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F418848A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41880E2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4188FC3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4188103635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:00:47.445+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:01:46.841+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] MongoDB starting : pid=25163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:01:46.848+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:01:46.895+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:01:47.203+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773707:203088][25163:0x7f7db3123c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:01:47.203+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:01:47.214+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7db2053635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DB2032000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DB2D0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DB2B06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DB280C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DB25F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DB23DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DB2032000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DB2F13000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7db2053635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:01:47.214+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:02:46.639+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] MongoDB starting : pid=25396 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:02:46.647+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:02:46.714+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:02:47.021+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773767:21465][25396:0x7f21161b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:02:47.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:02:47.032+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21150e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21150C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF011DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2115D99000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2115B95000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F211589B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2115686000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2115469000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21150C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2115FA2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21150e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:02:47.032+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:03:46.154+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] MongoDB starting : pid=25546 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:03:46.162+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:03:46.211+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:03:46.586+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773826:586769][25546:0x7f60db4aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:03:46.586+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:03:46.597+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f60da3da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F60DA3B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F60DB091000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F60DAE8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F60DAB93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F60DA97E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F60DA761000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F60DA3B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F60DB29A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f60da3da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:03:46.597+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:04:46.625+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] MongoDB starting : pid=25749 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:04:46.632+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:04:46.681+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:04:46.943+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773886:943775][25749:0x7faa5e4c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:04:46.943+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:04:46.954+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa5d3f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA5D3D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BAC2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA5E0AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA5DEAA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA5DBB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA5D99B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA5D77E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA5D3D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA5E2B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa5d3f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:04:46.954+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:05:46.085+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] MongoDB starting : pid=25986 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:05:46.093+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:05:46.142+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:05:46.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507773946:459570][25986:0x7f38a348bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:05:46.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:05:46.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f38a23bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38A239A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBBAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F38A3072000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38A2E6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F38A2B74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F38A295F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38A2742000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38A239A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38A327B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f38a23bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:05:46.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:06:46.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] MongoDB starting : pid=26202 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:06:46.905+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:06:46.961+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:06:47.288+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774007:287993][26202:0x7f49303cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:06:47.288+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:06:47.299+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f492f2fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F492F2D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D2AC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F492FFB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F492FDAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F492FAB3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F492F89E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F492F681000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F492F2D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F49301BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f492f2fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:06:47.299+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:07:46.447+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] MongoDB starting : pid=26332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:07:46.455+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:07:46.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:07:46.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774066:828562][26332:0x7fa64b388c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:07:46.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:07:46.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa64a2b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA64A297000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA64AF6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA64AD6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA64AA71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA64A85C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA64A63F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA64A297000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA64B178000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa64a2b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:07:46.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:08:46.967+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] MongoDB starting : pid=26591 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:08:46.974+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:08:47.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:08:47.354+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774127:354359][26591:0x7feea2576c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:08:47.354+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:08:47.365+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feea14a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEEA1485000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEEA215D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEEA1F59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEEA1C5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEEA1A4A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEEA182D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEEA1485000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEEA2366000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feea14a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:08:47.365+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:09:47.019+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] MongoDB starting : pid=26791 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:09:47.026+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:09:47.076+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:09:47.403+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774187:403741][26791:0x7f7447abac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:09:47.403+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:09:47.423+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74469ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74469C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97047000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74476A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F744749D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74471A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7446F8E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7446D71000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74469C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74478AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74469ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:09:47.423+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:10:46.547+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] MongoDB starting : pid=27021 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:10:46.555+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:10:46.610+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:10:46.975+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774246:975493][27021:0x7fcd08c9ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:10:46.975+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:10:46.986+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd07bca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD07BA9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF218FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD08881000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD0867D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD08383000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD0816E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD07F51000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD07BA9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD08A8A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd07bca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:10:46.986+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:11:46.444+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] MongoDB starting : pid=27228 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:11:46.452+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:11:46.501+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:11:46.848+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774306:848984][27228:0x7fcca2697c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:11:46.849+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:11:46.859+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcca15c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCA15A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C4C5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCA227E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCA207A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCA1D80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCA1B6B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCA194E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCA15A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCA2487000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcca15c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:11:46.859+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:12:46.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=27448 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:12:47.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:12:47.053+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:12:47.386+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774367:386565][27448:0x7fbffb0d4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:12:47.386+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:12:47.397+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbffa004635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBFF9FE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3C82000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBFFACBB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBFFAAB7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBFFA7BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBFFA5A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBFFA38B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBFF9FE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBFFAEC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbffa004635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:12:47.397+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:13:46.517+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=27766 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:13:46.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:13:46.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:13:46.940+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774426:940844][27766:0x7ffd6b05cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:13:46.940+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:13:46.961+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd69f8c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD69F6B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD6AC43000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD6AA3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD6A745000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD6A530000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD6A313000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD69F6B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD6AE4C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd69f8c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:13:46.961+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:14:46.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=27972 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:14:46.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:14:46.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:14:46.453+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774486:453527][27972:0x7fdffbb15c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:14:46.453+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:14:46.476+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdffaa45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFFAA24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFFB6FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFFB4F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFFB1FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFFAFE9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFFADCC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFFAA24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFFB905000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdffaa45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:14:46.476+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:15:46.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] MongoDB starting : pid=28205 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:15:46.606+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:15:46.656+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:15:46.976+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774546:976965][28205:0x7ffd407e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:15:46.977+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:15:46.987+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd3f713635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD3F6F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFD410F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD403CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD401C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD3FECC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD3FCB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD3FA9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD3F6F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD405D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd3f713635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:15:46.987+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:16:46.383+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] MongoDB starting : pid=28413 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:16:46.391+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:16:46.444+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:16:46.807+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774606:807696][28413:0x7f67917c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:16:46.807+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:16:46.827+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67906f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67906D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED7FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67913AC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67911A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6790EAE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6790C99000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6790A7C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67906D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67915B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67906f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:16:46.827+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:17:46.948+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] MongoDB starting : pid=28554 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:17:46.956+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:17:47.008+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:17:47.320+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774667:320206][28554:0x7f2774cf0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:17:47.320+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:17:47.331+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2773c20635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2773BFF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA9CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27748D7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27746D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F27743D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F27741C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2773FA7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2773BFF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2774AE0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2773c20635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:17:47.331+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:18:46.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=28823 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:18:46.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:18:46.520+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:18:46.770+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774726:770584][28823:0x7f618bc7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:18:46.770+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:18:46.781+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f618abad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F618AB8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42C41000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F618B864000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F618B660000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F618B366000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F618B151000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F618AF34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F618AB8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F618BA6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f618abad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:18:46.781+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:19:46.255+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] MongoDB starting : pid=29023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:19:46.263+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:19:46.313+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:19:46.601+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774786:601219][29023:0x7fbf9a63cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:19:46.601+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:19:46.611+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbf9956c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBF9954B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF628FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBF9A223000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBF9A01F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBF99D25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBF99B10000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBF998F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBF9954B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBF9A42C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbf9956c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:19:46.611+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:20:46.734+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] MongoDB starting : pid=29244 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:20:46.741+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:20:46.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:20:47.061+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774847:61625][29244:0x7f3f86250c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:20:47.061+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:20:47.073+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f85180635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F8515F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF902FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F85E37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F85C33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F85939000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F85724000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F85507000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F8515F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F86040000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f85180635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:20:47.073+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:21:46.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=29462 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:21:46.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:21:46.542+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:21:46.898+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774906:898687][29462:0x7f6be2cefc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:21:46.898+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:21:46.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6be1c1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6BE1BFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6BE28D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6BE26D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6BE23D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6BE21C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6BE1FA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6BE1BFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6BE2ADF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6be1c1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:21:46.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:22:47.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] MongoDB starting : pid=29616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:22:47.043+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:22:47.092+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:22:47.481+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507774967:481560][29616:0x7ff338cccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:22:47.481+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:22:47.500+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff337bfc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF337BDB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF688FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3388B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3386AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3383B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3381A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF337F83000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF337BDB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF338ABC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff337bfc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:22:47.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:23:46.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=29877 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:23:46.622+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:23:46.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:23:46.968+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775026:968740][29877:0x7f70fe4afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:23:46.968+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:23:46.988+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f70fd3df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F70FD3BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58E8A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F70FE096000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F70FDE92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F70FDB98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F70FD983000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F70FD766000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F70FD3BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F70FE29F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f70fd3df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:23:46.988+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:24:46.354+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] MongoDB starting : pid=30088 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:24:46.362+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:24:46.411+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:24:46.715+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775086:715023][30088:0x7fb622bafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:24:46.715+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:24:46.725+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb621adf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB621ABE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA16FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB622796000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB622592000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB622298000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB622083000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB621E66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB621ABE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB62299F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb621adf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:24:46.725+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:25:46.851+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] MongoDB starting : pid=30307 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:25:46.859+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:25:46.909+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:25:47.244+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775147:244735][30307:0x7fa308360c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:25:47.244+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:25:47.263+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa307290635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA30726F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8A70000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA307F47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA307D43000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA307A49000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA307834000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA307617000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA30726F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA308150000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa307290635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:25:47.264+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:26:46.702+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] MongoDB starting : pid=30544 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:26:46.708+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:26:46.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:26:46.985+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775206:985683][30544:0x7f6d50e36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:26:46.985+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:26:46.996+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6d4fd66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6D4FD45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6D50A1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6D50819000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6D5051F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6D5030A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6D500ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6D4FD45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6D50C26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6d4fd66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:26:46.997+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:27:46.129+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] MongoDB starting : pid=30686 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:27:46.137+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:27:46.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:27:46.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775266:559302][30686:0x7f8be01b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:27:46.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:27:46.570+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8bdf0e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BDF0C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1FFB6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BDFD9D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BDFB99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BDF89F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BDF68A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BDF46D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BDF0C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BDFFA6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8bdf0e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:27:46.570+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:28:46.691+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] MongoDB starting : pid=30957 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:28:46.699+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:28:46.751+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:28:47.030+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775327:30901][30957:0x7ff1f4e78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:28:47.030+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:28:47.043+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1f3da8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1F3D87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF72FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF1F4A5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF1F485B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF1F4561000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1F434C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1F412F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1F3D87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1F4C68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1f3da8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:28:47.043+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:29:46.651+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:29:46.658+0000 I CONTROL [initandlisten] MongoDB starting : pid=31155 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:29:46.659+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:29:46.709+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:29:47.098+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775387:98360][31155:0x7f7304519c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:29:47.098+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:29:47.117+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7303449635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7303428000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4603F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7304100000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7303EFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7303C02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73039ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73037D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7303428000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7304309000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7303449635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:29:47.117+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:30:46.233+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] MongoDB starting : pid=31365 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:30:46.241+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:30:46.291+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:30:46.614+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775446:614556][31365:0x7f968842cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:30:46.614+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:30:46.625+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f968735c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F968733B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48431000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9688013000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9687E0F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9687B15000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9687900000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96876E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F968733B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F968821C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f968735c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:30:46.625+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:31:47.015+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] MongoDB starting : pid=31597 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:31:47.024+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:31:47.074+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:31:47.367+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775507:367183][31597:0x7f140a5c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:31:47.367+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:31:47.377+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14094f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14094D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F140A1B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1409FAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1409CB2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1409A9D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1409880000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14094D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F140A3B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14094f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:31:47.377+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:32:46.503+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:32:46.510+0000 I CONTROL [initandlisten] MongoDB starting : pid=31740 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:32:46.510+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:32:46.510+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:32:46.511+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:32:46.511+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:32:46.511+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:32:46.511+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:32:46.511+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:32:46.511+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:32:46.560+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:32:46.909+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775566:909533][31740:0x7f7f2fcc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:32:46.909+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:32:46.929+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f2ebf3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F2EBD2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F2F8AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F2F6A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F2F3AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F2F197000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F2EF7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F2EBD2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F2FAB3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f2ebf3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:32:46.929+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:33:46.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] MongoDB starting : pid=31999 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:33:46.055+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:33:46.105+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:33:46.384+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775626:384213][31999:0x7fb08fe2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:33:46.384+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:33:46.395+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb08ed5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB08ED3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB08FA13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB08F80F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB08F515000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB08F300000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB08F0E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB08ED3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB08FC1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb08ed5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:33:46.395+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:34:46.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=32212 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:34:46.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:34:46.949+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:34:47.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775687:240369][32212:0x7ffd9cdb5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:34:47.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:34:47.250+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd9bce5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD9BCC4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E026000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD9C99C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD9C798000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD9C49E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD9C289000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD9C06C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD9BCC4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD9CBA5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd9bce5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:34:47.250+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:35:46.384+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=32424 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:35:46.392+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:35:46.448+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:35:46.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775746:795122][32424:0x7f6709931c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:35:46.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:35:46.805+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6708861635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6708840000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6DC2E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6709518000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6709314000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F670901A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6708E05000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6708BE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6708840000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6709721000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6708861635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:35:46.805+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:36:46.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] MongoDB starting : pid=32652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:36:46.250+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:36:46.300+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:36:46.619+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775806:619077][32652:0x7f1089305c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:36:46.619+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:36:46.638+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1088235635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1088214000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF49EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1088EEC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1088CE8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10889EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10887D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10885BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1088214000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F10890F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1088235635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:36:46.639+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:37:46.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=329 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:37:46.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:37:46.821+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:37:47.118+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775867:118059][329:0x7f5edaad4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:37:47.118+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:37:47.128+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ed9a04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5ED99E3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EDA6BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EDA4B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EDA1BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5ED9FA8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5ED9D8B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5ED99E3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EDA8C4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ed9a04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:37:47.128+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:38:46.256+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] MongoDB starting : pid=527 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:38:46.264+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:38:46.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:38:46.574+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775926:574815][527:0x7f3765d18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:38:46.574+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:38:46.585+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3764c48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3764C27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37658FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37656FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3765401000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37651EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3764FCF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3764C27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3765B08000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3764c48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:38:46.585+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:39:46.295+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] MongoDB starting : pid=713 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:39:46.303+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:39:46.353+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:39:46.654+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507775986:654663][713:0x7fabe50acc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:39:46.654+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:39:46.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabe3fdc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABE3FBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBCFFA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABE4C93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABE4A8F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABE4795000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABE4580000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABE4363000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABE3FBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABE4E9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabe3fdc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:39:46.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:40:46.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:40:46.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:40:46.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:40:46.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:40:46.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:40:46.810+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:40:46.810+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:40:46.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:40:46.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:40:46.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:40:46.862+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:40:47.223+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776047:223283][928:0x7f2a8e924c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:40:47.223+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:40:47.242+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2a8d854635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2A8D833000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2A8E50B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2A8E307000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2A8E00D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2A8DDF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2A8DBDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2A8D833000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2A8E714000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2a8d854635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:40:47.242+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:41:46.646+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=1166 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:41:46.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:41:46.705+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:41:47.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776107:3883][1166:0x7fd78f0ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:41:47.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:41:47.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd78dffc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD78DFDB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD78ECB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD78EAAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD78E7B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD78E5A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD78E383000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD78DFDB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD78EEBC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd78dffc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:41:47.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:42:46.147+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] MongoDB starting : pid=1401 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:42:46.154+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:42:46.205+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:42:46.568+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776166:568429][1401:0x7fe678f47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:42:46.568+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:42:46.592+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe677e77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE677E56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE678B2E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE67892A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE678630000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE67841B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE6781FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE677E56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE678D37000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe677e77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:42:46.592+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:43:46.732+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] MongoDB starting : pid=1547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:43:46.740+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:43:46.792+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:43:47.061+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776227:61626][1547:0x7ffa976e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:43:47.061+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:43:47.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa96612635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA965F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF354FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA972C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA970C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA96DCB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA96BB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA96999000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA965F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA974D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa96612635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:43:47.081+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:44:46.683+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] MongoDB starting : pid=1795 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:44:46.692+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:44:46.750+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:44:47.117+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776287:117200][1795:0x7f31168eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:44:47.117+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:44:47.136+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f311581e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F31157FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF71AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F31164D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F31162D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3115FD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3115DC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3115BA5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F31157FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F31166DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f311581e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:44:47.136+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:45:46.255+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] MongoDB starting : pid=2009 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:45:46.263+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:45:46.313+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:45:46.686+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776346:686337][2009:0x7fcd1026dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:45:46.686+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:45:46.706+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd0f19d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD0F17C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89ECF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD0FE54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD0FC50000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD0F956000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD0F741000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD0F524000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD0F17C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD1005D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd0f19d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:45:46.706+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:46:46.121+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] MongoDB starting : pid=2237 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:46:46.128+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:46:46.179+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:46:46.514+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776406:514835][2237:0x7f3f46cbcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:46:46.514+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:46:46.534+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f45bec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F45BCB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF45684000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F468A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F4669F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F463A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F46190000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F45F73000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F45BCB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F46AAC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f45bec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:46:46.534+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:47:46.649+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:47:46.657+0000 I CONTROL [initandlisten] MongoDB starting : pid=2467 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:47:46.657+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:47:46.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:47:46.711+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:47:47.013+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776467:13825][2467:0x7f6eb62ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:47:47.013+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:47:47.024+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6eb520d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6EB51EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6EB5EC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6EB5CC0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6EB59C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6EB57B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6EB5594000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6EB51EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6EB60CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6eb520d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:47:47.024+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:48:46.154+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] MongoDB starting : pid=2593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:48:46.162+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:48:46.213+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:48:46.600+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776526:600052][2593:0x7fd8283bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:48:46.600+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:48:46.620+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8272eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8272CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC02FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD827FA2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD827D9E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD827AA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD82788F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD827672000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8272CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8281AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8272eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:48:46.620+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:49:46.945+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] MongoDB starting : pid=2846 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:49:46.953+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:49:47.005+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:49:47.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776587:287370][2846:0x7f6db890ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:49:47.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:49:47.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6db783e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6DB781D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6DB84F5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6DB82F1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6DB7FF7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6DB7DE2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6DB7BC5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6DB781D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6DB86FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6db783e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:49:47.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:50:46.427+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=3062 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:50:46.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:50:46.485+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:50:46.773+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776646:773074][3062:0x7fcecb900c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:50:46.773+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:50:46.783+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fceca830635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCECA80F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12209000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCECB4E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCECB2E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCECAFE9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCECADD4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCECABB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCECA80F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCECB6F0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fceca830635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:50:46.783+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:51:46.243+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=3297 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:51:46.251+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:51:46.300+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:51:46.553+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776706:553434][3297:0x7ffa40c20c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:51:46.553+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:51:46.563+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa3fb50635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA3FB2F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA22FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA40807000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA40603000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA40309000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA400F4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA3FED7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA3FB2F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA40A10000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa3fb50635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:51:46.563+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:52:46.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] MongoDB starting : pid=3538 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:52:46.707+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:52:46.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:52:47.087+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776767:87852][3538:0x7f4a2408ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:52:47.087+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:52:47.098+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a22fba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A22F99000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A23C71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A23A6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A23773000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A2355E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A23341000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A22F99000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A23E7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a22fba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:52:47.098+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:53:46.218+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] MongoDB starting : pid=3664 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:53:46.227+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:53:46.278+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:53:46.660+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776826:660295][3664:0x7f20b6548c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:53:46.660+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:53:46.671+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f20b5478635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F20B5457000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7CC64000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F20B612F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F20B5F2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20B5C31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F20B5A1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F20B57FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F20B5457000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F20B6338000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f20b5478635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:53:46.671+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:54:46.453+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] MongoDB starting : pid=3922 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:54:46.461+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:54:46.511+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:54:46.859+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776886:859233][3922:0x7f6d1cd27c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:54:46.859+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:54:46.872+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6d1bc57635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6D1BC36000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF538FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6D1C90E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6D1C70A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6D1C410000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6D1C1FB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6D1BFDE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6D1BC36000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6D1CB17000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6d1bc57635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:54:46.872+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:55:46.998+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] MongoDB starting : pid=4127 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:55:47.006+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:55:47.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:55:47.375+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507776947:375680][4127:0x7fd3fd87fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:55:47.375+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:55:47.387+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3fc7af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3FC78E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFC5EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3FD466000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3FD262000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3FCF68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3FCD53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD3FCB36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3FC78E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3FD66F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3fc7af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:55:47.387+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:56:46.854+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] MongoDB starting : pid=4359 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:56:46.861+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:56:46.914+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:56:47.263+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777007:263439][4359:0x7f62c67c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:56:47.263+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:56:47.274+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62c56f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62C56D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62C63AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62C61A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62C5EAC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62C5C97000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62C5A7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62C56D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62C65B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62c56f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:56:47.274+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:57:46.407+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:57:46.415+0000 I CONTROL [initandlisten] MongoDB starting : pid=4587 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:57:46.416+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:57:46.466+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:57:46.838+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777066:838568][4587:0x7ffef67dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:57:46.838+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:57:46.859+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffef570b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFEF56EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFEF63C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFEF61BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFEF5EC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFEF5CAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFEF5A92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFEF56EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFEF65CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffef570b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:57:46.859+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:58:46.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=4737 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:58:46.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:58:47.045+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:58:47.336+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777127:336223][4737:0x7f6073aa9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:58:47.336+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:58:47.346+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f60729d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F60729B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6073690000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F607348C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6073192000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6072F7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6072D60000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F60729B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6073899000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f60729d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:58:47.346+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T02:59:46.473+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T02:59:46.480+0000 I CONTROL [initandlisten] MongoDB starting : pid=5065 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T02:59:46.480+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] modules: none 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] build environment: 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T02:59:46.481+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T02:59:46.533+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T02:59:46.905+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777186:905822][5065:0x7fa8e04bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T02:59:46.905+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T02:59:46.916+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8df3ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8DF3CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD5F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8E00A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8DFEA0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8DFBA6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8DF991000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8DF774000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8DF3CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8E02AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8df3ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T02:59:46.916+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:00:46.733+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] MongoDB starting : pid=5470 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:00:46.741+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:00:46.791+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:00:47.071+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777247:71487][5470:0x7fe7031afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:00:47.071+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:00:47.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7020df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7020BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF301E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE702D96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE702B92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE702898000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE702683000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE702466000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7020BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE702F9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7020df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:00:47.082+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:01:46.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=5881 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:01:46.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:01:46.520+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:01:46.796+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777306:796120][5881:0x7f6ceef1dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:01:46.796+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:01:46.806+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6cede4d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6CEDE2C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6CEEB04000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6CEE900000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6CEE606000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6CEE3F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6CEE1D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6CEDE2C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6CEED0D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6cede4d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:01:46.806+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:02:46.227+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:02:46.234+0000 I CONTROL [initandlisten] MongoDB starting : pid=6216 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:02:46.234+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:02:46.234+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:02:46.234+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:02:46.235+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:02:46.235+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:02:46.235+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:02:46.235+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:02:46.235+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:02:46.284+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:02:46.667+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777366:667887][6216:0x7f33a85edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:02:46.667+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:02:46.678+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33a751d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33A74FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF635B1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33A81D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33A7FD0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33A7CD6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33A7AC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33A78A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33A74FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33A83DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33a751d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:02:46.678+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:03:46.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=6395 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:03:46.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:03:46.861+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:03:47.166+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777427:166430][6395:0x7f93b6843c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:03:47.166+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:03:47.186+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93b5773635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93B5752000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93B642A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93B6226000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93B5F2C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93B5D17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93B5AFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93B5752000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93B6633000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93b5773635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:03:47.186+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:04:46.315+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] MongoDB starting : pid=6738 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:04:46.323+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:04:46.373+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:04:46.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777486:670923][6738:0x7f842c3e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:04:46.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:04:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f842b311635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F842B2F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F842BFC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F842BDC4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F842BACA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F842B8B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F842B698000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F842B2F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F842C1D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f842b311635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:04:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:05:46.923+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] MongoDB starting : pid=6943 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:05:46.930+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:05:46.980+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:05:47.278+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777547:278483][6943:0x7f2a62716c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:05:47.278+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:05:47.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2a61646635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2A61625000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2A622FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2A620F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2A61DFF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2A61BEA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2A619CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2A61625000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2A62506000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2a61646635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:05:47.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:06:46.698+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:06:46.705+0000 I CONTROL [initandlisten] MongoDB starting : pid=7177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:06:46.705+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:06:46.705+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:06:46.705+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:06:46.705+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:06:46.705+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:06:46.706+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:06:46.706+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:06:46.706+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:06:46.755+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:06:47.036+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777607:36986][7177:0x7f8d62fd3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:06:47.037+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:06:47.047+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d61f03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D61EE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B6A1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D62BBA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D629B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D626BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D624A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D6228A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D61EE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D62DC3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d61f03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:06:47.047+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:07:46.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] MongoDB starting : pid=7404 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:07:46.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:07:46.240+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:07:46.540+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777666:540898][7404:0x7ffc4c923c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:07:46.540+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:07:46.551+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc4b853635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC4B832000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC539F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC4C50A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC4C306000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC4C00C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC4BDF7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC4BBDA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC4B832000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC4C713000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc4b853635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:07:46.551+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:08:46.679+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] MongoDB starting : pid=7529 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:08:46.687+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:08:46.736+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:08:47.068+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777727:68971][7529:0x7ffd92e53c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:08:47.069+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:08:47.079+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd91d83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD91D62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD92A3A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD92836000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD9253C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD92327000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD9210A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD91D62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD92C43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd91d83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:08:47.079+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:09:46.202+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=7778 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:09:46.210+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:09:46.260+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:09:46.634+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777786:634435][7778:0x7f249a8a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:09:46.634+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:09:46.653+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24997d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24997AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0CDE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F249A487000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F249A283000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2499F89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2499D74000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2499B57000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24997AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F249A690000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24997d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:09:46.653+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:10:46.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] MongoDB starting : pid=7988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:10:46.582+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:10:46.632+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:10:46.959+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777846:959722][7988:0x7f4a042ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:10:46.959+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:10:46.979+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a031fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A031DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0065000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A03EB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A03CAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A039B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A037A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A03583000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A031DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A040BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a031fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:10:46.979+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:11:46.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] MongoDB starting : pid=8226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:11:46.350+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:11:46.401+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:11:46.766+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777906:766813][8226:0x7feb668afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:11:46.766+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:11:46.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb657df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB657BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB66496000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB66292000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB65F98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB65D83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB65B66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB657BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB6669F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb657df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:11:46.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:12:46.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] MongoDB starting : pid=8464 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:12:46.923+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:12:46.974+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:12:47.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507777967:318139][8464:0x7f7165327c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:12:47.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:12:47.333+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7164257635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7164236000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7164F0E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7164D0A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7164A10000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71647FB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71645DE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7164236000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7165117000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7164257635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:12:47.333+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:13:46.457+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] MongoDB starting : pid=8611 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:13:46.465+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:13:46.516+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:13:46.848+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778026:848472][8611:0x7f500a616c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:13:46.848+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:13:46.868+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5009546635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5009525000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0AF7D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F500A1FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5009FF9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5009CFF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5009AEA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F50098CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5009525000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F500A406000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5009546635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:13:46.868+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:14:46.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=8806 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:14:47.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:14:47.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:14:47.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778087:377898][8806:0x7f80aa43fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:14:47.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:14:47.388+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80a936f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80A934E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80AA026000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80A9E22000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80A9B28000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80A9913000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80A96F6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80A934E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80AA22F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80a936f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:14:47.388+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:15:46.922+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] MongoDB starting : pid=8969 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:15:46.930+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:15:46.979+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:15:47.284+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778147:284291][8969:0x7f7dfe3f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:15:47.284+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:15:47.303+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dfd327635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DFD306000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE6F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DFDFDE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DFDDDA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DFDAE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DFD8CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DFD6AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DFD306000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DFE1E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dfd327635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:15:47.304+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:16:46.713+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] MongoDB starting : pid=9206 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:16:46.722+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:16:46.773+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:16:47.133+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778207:133625][9206:0x7f3c45411c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:16:47.133+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:16:47.153+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c44341635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C44320000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C44FF8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C44DF4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C44AFA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C448E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C446C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C44320000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C45201000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c44341635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:16:47.153+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:17:46.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] MongoDB starting : pid=9441 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:17:46.282+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:17:46.332+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:17:46.598+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778266:598026][9441:0x7f8d30eb4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:17:46.598+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:17:46.608+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d2fde4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D2FDC3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEF6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D30A9B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D30897000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D3059D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D30388000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D3016B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D2FDC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D30CA4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d2fde4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:17:46.608+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:18:46.748+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] MongoDB starting : pid=9652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:18:46.756+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:18:46.808+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:18:47.168+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778327:168448][9652:0x7f44d6b68c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:18:47.168+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:18:47.188+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44d5a98635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44D5A77000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF554FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44D674F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44D654B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44D6251000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44D603C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44D5E1F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44D5A77000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44D6958000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44d5a98635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:18:47.188+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:19:46.315+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] MongoDB starting : pid=9764 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:19:46.323+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:19:46.375+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:19:46.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778386:661325][9764:0x7f27201efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:19:46.661+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:19:46.671+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f271f11f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F271F0FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEBEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F271FDD6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F271FBD2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F271F8D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F271F6C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F271F4A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F271F0FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F271FFDF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f271f11f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:19:46.671+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:20:46.314+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=10017 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:20:46.322+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:20:46.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:20:46.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778446:674964][10017:0x7f46e9accc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:20:46.675+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:20:46.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f46e89fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F46E89DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9A4BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F46E96B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F46E94AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F46E91B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F46E8FA0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F46E8D83000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F46E89DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F46E98BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f46e89fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:20:46.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:21:46.075+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] MongoDB starting : pid=10264 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:21:46.083+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:21:46.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:21:46.423+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778506:423053][10264:0x7f51da100c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:21:46.423+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:21:46.434+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51d9030635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51D900F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8ACE0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51D9CE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51D9AE3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51D97E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51D95D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51D93B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51D900F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51D9EF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51d9030635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:21:46.434+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:22:46.556+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] MongoDB starting : pid=10495 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:22:46.564+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:22:46.615+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:22:46.923+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778566:923756][10495:0x7f9c50e96c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:22:46.923+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:22:46.943+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c4fdc6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C4FDA5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C50A7D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C50879000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C5057F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C5036A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C5014D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C4FDA5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C50C86000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c4fdc6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:22:46.943+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:23:46.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=10711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:23:46.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:23:46.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:23:46.421+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778626:421272][10711:0x7f15a5003c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:23:46.421+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:23:46.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15a3f33635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15A3F12000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0605F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15A4BEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15A49E6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15A46EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15A44D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15A42BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15A3F12000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15A4DF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15a3f33635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:23:46.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:24:46.567+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] MongoDB starting : pid=10831 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:24:46.575+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:24:46.624+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:24:46.977+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778686:977790][10831:0x7f3e08a21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:24:46.977+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:24:46.997+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e07951635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E07930000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6E30000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E08608000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E08404000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E0810A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E07EF5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E07CD8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E07930000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E08811000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e07951635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:24:46.997+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:25:46.478+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] MongoDB starting : pid=11083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:25:46.486+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:25:46.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:25:46.891+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778746:890985][11083:0x7ff367a81c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:25:46.891+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:25:46.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3669b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF366990000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF22FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF367668000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF367464000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF36716A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF366F55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF366D38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF366990000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF367871000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3669b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:25:46.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:26:46.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] MongoDB starting : pid=11316 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:26:46.431+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:26:46.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:26:46.840+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778806:840359][11316:0x7ffa1f6f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:26:46.840+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:26:46.859+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa1e627635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA1E606000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08A7A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA1F2DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA1F0DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA1EDE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA1EBCB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA1E9AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA1E606000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA1F4E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa1e627635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:26:46.859+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:27:46.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:27:47.003+0000 I CONTROL [initandlisten] MongoDB starting : pid=11553 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:27:47.003+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:27:47.003+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:27:47.003+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:27:47.003+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:27:47.004+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:27:47.004+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:27:47.004+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:27:47.004+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:27:47.054+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:27:47.444+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778867:444862][11553:0x7f7639a8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:27:47.445+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:27:47.464+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f76389bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F763899C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE8D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7639674000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7639470000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7639176000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7638F61000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7638D44000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F763899C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F763987D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f76389bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:27:47.464+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:28:46.597+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] MongoDB starting : pid=11777 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:28:46.605+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:28:46.656+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:28:46.993+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778926:993822][11777:0x7f52ecd9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:28:46.993+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:28:47.004+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52ebccc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52EBCAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF0C0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52EC983000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52EC77F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52EC485000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52EC270000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52EC053000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52EBCAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52ECB8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52ebccc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:28:47.004+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:29:46.140+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] MongoDB starting : pid=11902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:29:46.148+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:29:46.198+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:29:46.468+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507778986:468623][11902:0x7ff1912edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:29:46.468+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:29:46.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff19021d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1901FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF648F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF190ED4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF190CD0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF1909D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1907C1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1905A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1901FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1910DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff19021d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:29:46.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:30:46.685+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] MongoDB starting : pid=12168 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:30:46.693+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:30:46.743+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:30:47.024+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779047:24708][12168:0x7f0a13d3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:30:47.024+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:30:47.035+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a12c6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A12C4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0093000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A13925000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A13721000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A13427000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A13212000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A12FF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A12C4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A13B2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a12c6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:30:47.035+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:31:46.443+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] MongoDB starting : pid=12417 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:31:46.451+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:31:46.502+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:31:46.796+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779106:796261][12417:0x7f82cfa78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:31:46.796+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:31:46.806+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f82ce9a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F82CE987000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F82CF65F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F82CF45B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F82CF161000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F82CEF4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F82CED2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F82CE987000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F82CF868000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f82ce9a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:31:46.807+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:32:46.940+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] MongoDB starting : pid=12651 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:32:46.948+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:32:46.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:32:47.294+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779167:294289][12651:0x7f98b20c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:32:47.294+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:32:47.305+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98b0ff0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98B0FCF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF622FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98B1CA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98B1AA3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98B17A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98B1594000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98B1377000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98B0FCF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98B1EB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98b0ff0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:32:47.305+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:33:46.441+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] MongoDB starting : pid=12862 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:33:46.450+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:33:46.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:33:46.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779226:894240][12862:0x7f28961a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:33:46.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:33:46.915+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28950d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28950B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF854FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2895D88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2895B84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F289588A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2895675000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2895458000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28950B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2895F91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28950d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:33:46.915+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:34:47.045+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] MongoDB starting : pid=12990 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:34:47.053+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:34:47.102+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:34:47.413+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779287:413673][12990:0x7f900f7f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:34:47.413+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:34:47.425+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f900e723635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F900E702000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBDCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F900F3DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F900F1D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F900EEDC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F900ECC7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F900EAAA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F900E702000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F900F5E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f900e723635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:34:47.425+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:35:46.164+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] MongoDB starting : pid=13240 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:35:46.173+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:35:46.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:35:46.598+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779346:598302][13240:0x7f82a42c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:35:46.598+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:35:46.617+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f82a31f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F82A31D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF22C5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F82A3EA8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F82A3CA4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F82A39AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F82A3795000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F82A3578000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F82A31D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F82A40B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f82a31f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:35:46.617+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:36:47.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] MongoDB starting : pid=13490 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:36:47.053+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:36:47.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:36:47.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:36:47.109+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:36:47.454+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779407:454731][13490:0x7f3a8a63ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:36:47.454+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:36:47.465+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3a8956a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3A89549000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE14FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3A8A221000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3A8A01D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3A89D23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3A89B0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3A898F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3A89549000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3A8A42A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3a8956a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:36:47.465+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:37:46.591+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] MongoDB starting : pid=13717 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:37:46.599+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:37:46.650+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:37:46.971+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779466:971106][13717:0x7f7f3deafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:37:46.971+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:37:46.981+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f3cddf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F3CDBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53B2D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F3DA96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F3D892000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F3D598000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F3D383000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F3D166000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F3CDBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F3DC9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f3cddf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:37:46.981+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:38:46.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=13924 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:38:46.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:38:46.173+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:38:46.572+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779526:572051][13924:0x7f8e6381cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:38:46.572+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:38:46.591+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e6274c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E6272B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E63403000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E631FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E62F05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E62CF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E62AD3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E6272B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E6360C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e6274c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:38:46.591+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:39:46.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] MongoDB starting : pid=14052 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:39:46.721+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:39:46.776+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:39:47.084+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779587:84523][14052:0x7ff41f1dac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:39:47.084+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:39:47.094+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff41e10a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF41E0E9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CCC5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF41EDC1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF41EBBD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF41E8C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF41E6AE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF41E491000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF41E0E9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF41EFCA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff41e10a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:39:47.095+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:40:46.266+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:40:46.273+0000 I CONTROL [initandlisten] MongoDB starting : pid=14304 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:40:46.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:40:46.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:40:46.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:40:46.273+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:40:46.273+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:40:46.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:40:46.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:40:46.274+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:40:46.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:40:46.621+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779646:621491][14304:0x7f6395c91c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:40:46.621+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:40:46.641+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6394bc1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6394BA0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF204F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6395878000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6395674000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F639537A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6395165000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6394F48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6394BA0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6395A81000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6394bc1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:40:46.641+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:41:47.023+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] MongoDB starting : pid=14876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:41:47.031+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:41:47.082+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:41:47.420+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779707:420324][14876:0x7fd0cc264c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:41:47.420+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:41:47.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0cb194635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0CB173000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD0CBE4B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0CBC47000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0CB94D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0CB738000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0CB51B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0CB173000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0CC054000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0cb194635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:41:47.439+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:42:46.561+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] MongoDB starting : pid=15147 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:42:46.566+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:42:46.593+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:42:46.825+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779766:825817][15147:0x7fd12a0a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:42:46.825+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:42:46.836+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd128fd8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD128FB7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD129C8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD129A8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD129791000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD12957C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD12935F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD128FB7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD129E98000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd128fd8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:42:46.836+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:43:46.973+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] MongoDB starting : pid=15375 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:43:46.980+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:43:47.029+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:43:47.347+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779827:347169][15375:0x7ff29a103c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:43:47.347+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:43:47.357+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff299033635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF299012000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C9FA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF299CEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF299AE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2997EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF2995D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF2993BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF299012000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF299EF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff299033635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:43:47.357+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:44:46.476+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] MongoDB starting : pid=15496 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:44:46.484+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:44:46.485+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:44:46.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:44:46.923+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779886:923676][15496:0x7fc9fd0f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:44:46.923+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:44:46.943+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9fc024635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9FC003000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF927F5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9FCCDB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9FCAD7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9FC7DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9FC5C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9FC3AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9FC003000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9FCEE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9fc024635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:44:46.943+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:45:46.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=15748 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:45:46.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:45:46.402+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:45:46.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507779946:751877][15748:0x7f795262fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:45:46.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:45:46.762+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f795155f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F795153E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F8AE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7952216000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7952012000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7951D18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7951B03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79518E6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F795153E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F795241F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f795155f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:45:46.762+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:46:46.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=15984 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:46:46.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:46:46.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:46:46.558+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780006:558118][15984:0x7f113c7fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:46:46.558+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:46:46.577+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f113b72b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F113B70A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA70FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F113C3E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F113C1DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F113BEE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F113BCCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F113BAB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F113B70A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F113C5EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f113b72b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:46:46.577+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:47:46.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] MongoDB starting : pid=16213 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:47:46.721+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:47:46.770+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:47:47.128+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780067:128124][16213:0x7f7324c93c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:47:47.128+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:47:47.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7323bc3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7323BA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DE5A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F732487A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7324676000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F732437C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7324167000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7323F4A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7323BA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7324A83000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7323bc3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:47:47.147+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:48:46.278+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] MongoDB starting : pid=16421 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:48:46.286+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:48:46.336+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:48:46.626+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780126:626535][16421:0x7f0ef4838c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:48:46.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:48:46.637+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ef3768635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EF3747000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EF441F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EF421B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EF3F21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EF3D0C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EF3AEF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EF3747000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EF4628000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ef3768635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:48:46.637+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:49:46.770+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] MongoDB starting : pid=16537 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:49:46.777+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:49:46.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:49:47.192+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780187:192384][16537:0x7f9b23900c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:49:47.192+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:49:47.211+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b22830635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B2280F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39A6A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B234E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B232E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B22FE9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B22DD4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B22BB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B2280F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B236F0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b22830635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:49:47.211+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:50:46.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] MongoDB starting : pid=16667 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:50:46.613+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:50:46.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:50:46.962+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780246:962610][16667:0x7f0d210f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:50:46.962+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:50:46.973+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d20021635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D20000000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF75887000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D20CD8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D20AD4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D207DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D205C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D203A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D20000000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D20EE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d20021635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:50:46.973+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:51:46.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=16932 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:51:46.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:51:46.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:51:46.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780306:724391][16932:0x7f760c33ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:51:46.724+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:51:46.736+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f760b26a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F760B249000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF226FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F760BF21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F760BD1D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F760BA23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F760B80E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F760B5F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F760B249000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F760C12A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f760b26a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:51:46.736+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:52:46.865+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] MongoDB starting : pid=17163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:52:46.872+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:52:46.922+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:52:47.187+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780367:187619][17163:0x7f3ce64d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:52:47.187+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:52:47.206+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3ce5400635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3CE53DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3CE60B7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3CE5EB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3CE5BB9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3CE59A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3CE5787000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3CE53DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3CE62C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3ce5400635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:52:47.206+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:53:46.344+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=17370 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:53:46.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:53:46.403+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:53:46.764+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780426:764338][17370:0x7f9b0a8edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:53:46.764+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:53:46.774+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b0981d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B097FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B0A4D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B0A2D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B09FD6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B09DC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B09BA4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B097FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B0A6DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b0981d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:53:46.774+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:54:46.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] MongoDB starting : pid=17575 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:54:46.901+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:54:46.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:54:47.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780487:315444][17575:0x7fc32f532c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:54:47.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:54:47.335+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc32e462635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC32E441000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC32F119000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC32EF15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC32EC1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC32EA06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC32E7E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC32E441000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC32F322000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc32e462635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:54:47.335+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:55:47.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=17693 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:55:47.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:55:47.100+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:55:47.444+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780547:444359][17693:0x7fce192a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:55:47.444+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:55:47.464+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fce181d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCE181B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCE18E8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCE18C8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCE18991000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCE1877C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCE1855F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCE181B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCE19098000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fce181d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:55:47.464+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:56:46.879+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=17989 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:56:46.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:56:46.937+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:56:47.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780607:218903][17989:0x7f8ddf242c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:56:47.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:56:47.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8dde172635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8DDE151000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF294B1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8DDEE29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8DDEC25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8DDE92B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8DDE716000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8DDE4F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8DDE151000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8DDF032000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8dde172635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:56:47.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:57:46.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=18217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:57:46.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:57:46.407+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:57:46.708+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780666:708848][18217:0x7f7aa6aedc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:57:46.708+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:57:46.719+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7aa5a1d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7AA59FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63A01000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7AA66D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7AA64D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7AA61D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7AA5FC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7AA5DA4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7AA59FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7AA68DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7aa5a1d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:57:46.719+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:58:46.840+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] MongoDB starting : pid=18443 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:58:46.847+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:58:46.903+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:58:47.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780727:240808][18443:0x7fad63053c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:58:47.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:58:47.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fad61f83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAD61F62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAD62C3A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAD62A36000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAD6273C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAD62527000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAD6230A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAD61F62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAD62E43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fad61f83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:58:47.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T03:59:46.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] MongoDB starting : pid=18646 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] modules: none 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] build environment: 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T03:59:46.382+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T03:59:46.432+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T03:59:46.732+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780786:732085][18646:0x7f1dd4a3fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T03:59:46.732+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T03:59:46.742+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dd396f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DD394E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF482D2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DD4626000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DD4422000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DD4128000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DD3F13000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DD3CF6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DD394E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DD482F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dd396f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T03:59:46.742+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:00:46.426+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] MongoDB starting : pid=18764 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:00:46.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:00:46.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:00:46.484+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:00:46.862+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780846:862572][18764:0x7fc136d00c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:00:46.862+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:00:46.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc135c30635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC135C0F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC1368E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC1366E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC1363E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1361D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC135FB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC135C0F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC136AF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc135c30635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:00:46.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:01:46.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] MongoDB starting : pid=19058 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:01:46.282+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:01:46.333+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:01:46.681+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780906:681237][19058:0x7fc925e42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:01:46.681+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:01:46.691+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc924d72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC924D51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF11EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC925A29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC925825000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC92552B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC925316000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9250F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC924D51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC925C32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc924d72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:01:46.691+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:02:46.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=19350 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:02:46.294+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:02:46.344+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:02:46.649+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507780966:649388][19350:0x7fe217578c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:02:46.649+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:02:46.659+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2164a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE216487000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE12FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE21715F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE216F5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE216C61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE216A4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE21682F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE216487000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE217368000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2164a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:02:46.659+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:03:46.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=19556 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:03:46.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:03:46.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:03:47.134+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781027:134984][19556:0x7f56b6658c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:03:47.135+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:03:47.145+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56b5588635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56B5567000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5723B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56B623F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56B603B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56B5D41000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56B5B2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56B590F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56B5567000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56B6448000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56b5588635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:03:47.145+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:04:46.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] MongoDB starting : pid=19760 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:04:46.265+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:04:46.314+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:04:46.660+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781086:660108][19760:0x7ff1044afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:04:46.660+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:04:46.670+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1033df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1033BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF104096000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF103E92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF103B98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF103983000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF103766000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1033BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF10429F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1033df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:04:46.670+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:05:46.629+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:05:46.635+0000 I CONTROL [initandlisten] MongoDB starting : pid=19888 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:05:46.635+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:05:46.636+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:05:46.685+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:05:47.044+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781147:44855][19888:0x7f413f636c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:05:47.044+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:05:47.055+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f413e566635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F413E545000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF324FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F413F21D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F413F019000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F413ED1F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F413EB0A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F413E8ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F413E545000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F413F426000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f413e566635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:05:47.055+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:06:46.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] MongoDB starting : pid=20189 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:06:46.437+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:06:46.491+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:06:46.871+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781206:871250][20189:0x7f1724ecfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:06:46.871+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:06:46.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1723e01635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1723DE0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F17257E0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1724AB8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17248B4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17245BA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17243A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1724188000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1723DE0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1724CC1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1723e01635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:06:46.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:07:47.026+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] MongoDB starting : pid=20428 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:07:47.033+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:07:47.082+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:07:47.472+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781267:472864][20428:0x7f0ee6d26c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:07:47.472+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:07:47.491+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ee5c56635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EE5C35000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB6DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EE690D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EE6709000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EE640F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EE61FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EE5FDD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EE5C35000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EE6B16000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ee5c56635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:07:47.491+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:08:46.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] MongoDB starting : pid=20655 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:08:46.621+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:08:46.670+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:08:46.975+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781326:975419][20655:0x7f813d7e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:08:46.975+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:08:46.985+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f813c714635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F813C6F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF746FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F813D3CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F813D1C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F813CECD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F813CCB8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F813CA9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F813C6F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F813D5D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f813c714635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:08:46.985+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:09:46.118+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] MongoDB starting : pid=20868 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:09:46.125+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:09:46.176+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:09:46.495+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781386:495232][20868:0x7fe91c536c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:09:46.495+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:09:46.505+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe91b466635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE91B445000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA52B3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE91C11D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE91BF19000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE91BC1F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE91BA0A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE91B7ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE91B445000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE91C326000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe91b466635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:09:46.505+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:10:46.783+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] MongoDB starting : pid=21019 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:10:46.791+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:10:46.841+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:10:47.124+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781447:124283][21019:0x7f481218bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:10:47.124+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:10:47.135+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f48110bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F481109A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4811D72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4811B6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4811874000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F481165F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4811442000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F481109A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4811F7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f48110bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:10:47.135+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:11:46.528+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] MongoDB starting : pid=21320 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:11:46.535+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:11:46.584+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:11:46.918+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781506:918102][21320:0x7f70b4a59c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:11:46.918+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:11:46.928+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f70b3989635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F70B3968000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFA14000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F70B4640000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F70B443C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F70B4142000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F70B3F2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F70B3D10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F70B3968000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F70B4849000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f70b3989635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:11:46.928+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:12:46.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=21626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:12:46.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:12:46.115+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:12:46.461+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781566:461547][21626:0x7fe19c135c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:12:46.461+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:12:46.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe19b065635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE19B044000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE19BD1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE19BB18000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE19B81E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE19B609000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE19B3EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE19B044000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE19BF25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe19b065635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:12:46.475+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:13:46.589+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] MongoDB starting : pid=21857 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:13:46.597+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:13:46.647+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:13:46.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781626:994896][21857:0x7f8908447c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:13:46.994+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:13:47.005+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8907377635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8907356000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF848FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F890802E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8907E2A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8907B30000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F890791B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F89076FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8907356000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8908237000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8907377635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:13:47.005+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:14:46.126+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] MongoDB starting : pid=22070 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:14:46.134+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:14:46.185+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:14:46.532+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781686:532868][22070:0x7fb6bee30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:14:46.532+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:14:46.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb6bdd60635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB6BDD3F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF181B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB6BEA17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB6BE813000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB6BE519000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB6BE304000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB6BE0E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB6BDD3F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB6BEC20000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb6bdd60635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:14:46.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:15:46.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=22196 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:15:46.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:15:46.396+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:15:46.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781746:741445][22196:0x7f5588a6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:15:46.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:15:46.760+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f558799d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F558797C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8BAB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5588654000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5588450000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5588156000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5587F41000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5587D24000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F558797C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F558885D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f558799d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:15:46.760+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:16:46.166+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:16:46.173+0000 I CONTROL [initandlisten] MongoDB starting : pid=22502 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:16:46.174+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:16:46.225+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:16:46.504+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781806:504901][22502:0x7f7eb9647c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:16:46.504+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:16:46.515+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7eb8577635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EB8556000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EB922E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EB902A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EB8D30000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EB8B1B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EB88FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EB8556000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EB9437000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7eb8577635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:16:46.515+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:17:46.631+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] MongoDB starting : pid=22741 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:17:46.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:17:46.687+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:17:47.057+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781867:57339][22741:0x7f4a69a46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:17:47.057+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:17:47.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a68976635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A68955000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56E0E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A6962D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A69429000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A6912F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A68F1A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A68CFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A68955000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A69836000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a68976635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:17:47.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:18:46.209+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=22968 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:18:46.217+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:18:46.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:18:46.534+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781926:534187][22968:0x7f3de7f54c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:18:46.534+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:18:46.544+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3de6e84635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DE6E63000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5AAB9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DE7B3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DE7937000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DE763D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DE7428000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DE720B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DE6E63000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DE7D44000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3de6e84635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:18:46.544+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:19:46.663+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] MongoDB starting : pid=23177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:19:46.670+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:19:46.720+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:19:47.122+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507781987:122563][23177:0x7f1c47a6cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:19:47.122+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:19:47.144+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c4699c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C4697B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C47653000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C4744F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C47155000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C46F40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C46D23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C4697B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C4785C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c4699c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:19:47.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:20:46.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] MongoDB starting : pid=23303 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:20:46.696+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:20:46.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:20:47.083+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782047:83461][23303:0x7f96b9e07c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:20:47.083+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:20:47.103+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96b8d37635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96B8D16000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF29EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96B99EE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96B97EA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96B94F0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96B92DB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96B90BE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96B8D16000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96B9BF7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96b8d37635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:20:47.103+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:21:46.519+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] MongoDB starting : pid=23613 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:21:46.526+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:21:46.576+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:21:46.930+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782106:930122][23613:0x7fcab62dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:21:46.930+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:21:46.940+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcab520f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCAB51EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60477000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCAB5EC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCAB5CC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCAB59C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCAB57B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCAB5596000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCAB51EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCAB60CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcab520f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:21:46.940+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:22:46.066+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] MongoDB starting : pid=23841 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:22:46.073+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:22:46.123+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:22:46.473+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782166:473880][23841:0x7f6f1b3a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:22:46.473+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:22:46.493+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f1a2d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F1A2B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F788000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F1AF89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F1AD85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F1AA8B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F1A876000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F1A659000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F1A2B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F1B192000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f1a2d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:22:46.493+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:23:46.628+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] MongoDB starting : pid=24067 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:23:46.635+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:23:46.685+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:23:46.997+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782226:997875][24067:0x7fc816b73c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:23:46.997+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:23:47.009+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc815aa3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC815A82000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCDEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC81675A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC816556000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC81625C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC816047000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC815E2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC815A82000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC816963000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc815aa3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:23:47.009+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:24:46.140+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:24:46.147+0000 I CONTROL [initandlisten] MongoDB starting : pid=24279 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:24:46.147+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:24:46.148+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:24:46.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:24:46.503+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782286:503211][24279:0x7f76685dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:24:46.503+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:24:46.514+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f766750b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F76674EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9293000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F76681C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7667FBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7667CC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7667AAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7667892000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F76674EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F76683CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f766750b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:24:46.514+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:25:46.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=24403 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:25:46.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:25:46.144+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:25:46.512+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782346:512862][24403:0x7fe4e1497c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:25:46.512+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:25:46.532+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4e03c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4E03A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE64B4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4E107E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4E0E7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4E0B80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4E096B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4E074E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4E03A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4E1287000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4e03c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:25:46.532+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:26:46.929+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] MongoDB starting : pid=24617 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:26:46.936+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:26:46.986+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:26:47.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782407:261844][24617:0x7f9e9c25fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:26:47.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:26:47.272+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e9b18f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E9B16E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA29CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E9BE46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E9BC42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E9B948000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E9B733000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E9B516000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E9B16E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E9C04F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e9b18f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:26:47.272+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:27:46.397+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] MongoDB starting : pid=24832 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:27:46.404+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:27:46.455+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:27:46.734+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782466:734848][24832:0x7fd6c7ff4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:27:46.734+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:27:46.755+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd6c6f24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD6C6F03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64AD6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD6C7BDB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6C79D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD6C76DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD6C74C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD6C72AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD6C6F03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD6C7DE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd6c6f24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:27:46.755+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:28:46.873+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] MongoDB starting : pid=25072 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:28:46.880+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:28:46.929+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:28:47.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782527:209886][25072:0x7f9f95a35c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:28:47.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:28:47.220+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9f94965635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9F94944000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF69AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9F9561C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9F95418000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9F9511E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9F94F09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9F94CEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9F94944000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9F95825000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9f94965635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:28:47.220+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:29:46.346+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] MongoDB starting : pid=25282 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:29:46.354+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:29:46.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:29:46.748+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782586:748903][25282:0x7f8a44642c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:29:46.748+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:29:46.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8a43572635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8A43551000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF47ECA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8A44229000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8A44025000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8A43D2B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8A43B16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8A438F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8A43551000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8A44432000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8a43572635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:29:46.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:30:46.874+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] MongoDB starting : pid=25487 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:30:46.881+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:30:46.931+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:30:47.308+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782647:308000][25487:0x7f8e3b2c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:30:47.308+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:30:47.327+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e3a1f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E3A1D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E3AEAD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E3ACA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E3A9AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E3A79A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E3A57D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E3A1D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E3B0B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e3a1f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:30:47.327+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:31:46.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] MongoDB starting : pid=25626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:31:46.769+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:31:46.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:31:47.148+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782707:148284][25626:0x7fee103abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:31:47.148+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:31:47.160+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee0f2db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE0F2BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF932FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE0FF92000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE0FD8E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE0FA94000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE0F87F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE0F662000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE0F2BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE1019B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee0f2db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:31:47.160+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:32:46.275+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] MongoDB starting : pid=25900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:32:46.282+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:32:46.334+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:32:46.690+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782766:690729][25900:0x7f4a7f4b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:32:46.690+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:32:46.710+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a7e3e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A7E3C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A7F099000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A7EE95000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A7EB9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A7E986000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A7E769000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A7E3C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A7F2A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a7e3e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:32:46.710+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:33:46.847+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] MongoDB starting : pid=26143 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:33:46.855+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:33:46.905+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:33:47.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782827:173983][26143:0x7f207b609c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:33:47.174+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:33:47.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f207a539635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F207A518000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F207B1F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F207AFEC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F207ACF2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F207AADD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F207A8C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F207A518000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F207B3F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f207a539635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:33:47.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:34:46.307+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] MongoDB starting : pid=26364 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:34:46.314+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:34:46.363+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:34:46.753+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782886:753845][26364:0x7f89b872dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:34:46.753+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:34:46.773+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f89b765d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F89B763C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF857F7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F89B8314000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F89B8110000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F89B7E16000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F89B7C01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F89B79E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F89B763C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F89B851D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f89b765d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:34:46.773+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:35:46.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=26571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:35:46.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:35:46.956+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:35:47.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507782947:306455][26571:0x7f8644678c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:35:47.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:35:47.317+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86435a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8643587000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F864425F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F864405B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8643D61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8643B4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F864392F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8643587000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8644468000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86435a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:35:47.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:36:47.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] MongoDB starting : pid=26721 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:36:47.062+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:36:47.112+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:36:47.403+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783007:403608][26721:0x7fe302b1fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:36:47.403+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:36:47.414+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe301a4f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE301A2E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF91BBD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE302706000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE302502000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE302208000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE301FF3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE301DD6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE301A2E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE30290F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe301a4f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:36:47.414+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:37:46.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] MongoDB starting : pid=26980 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:37:46.551+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:37:46.600+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:37:46.901+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783066:901232][26980:0x7ff2c1c13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:37:46.901+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:37:46.911+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff2c0b43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF2C0B22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF2C17FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF2C15F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2C12FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF2C10E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF2C0ECA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF2C0B22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF2C1A03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff2c0b43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:37:46.911+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:38:47.026+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] MongoDB starting : pid=27229 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:38:47.033+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:38:47.083+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:38:47.481+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783127:481586][27229:0x7fe319415c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:38:47.481+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:38:47.500+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe318345635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE318324000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF980FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE318FFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE318DF8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE318AFE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE3188E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE3186CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE318324000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE319205000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe318345635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:38:47.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:39:46.631+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] MongoDB starting : pid=27438 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:39:46.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:39:46.689+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:39:46.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783186:964282][27438:0x7f45ad368c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:39:46.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:39:46.974+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45ac298635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45AC277000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB16AD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45ACF4F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45ACD4B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45ACA51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F45AC83C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F45AC61F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45AC277000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45AD158000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45ac298635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:39:46.975+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:40:46.107+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] MongoDB starting : pid=27639 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:40:46.114+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:40:46.164+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:40:46.493+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783246:493979][27639:0x7fe45055dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:40:46.494+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:40:46.505+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe44f48d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE44F46C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5FE17000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE450144000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE44FF40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE44FC46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE44FA31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE44F814000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE44F46C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE45034D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe44f48d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:40:46.505+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:41:46.111+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] MongoDB starting : pid=27791 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:41:46.118+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:41:46.168+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:41:46.449+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783306:449507][27791:0x7f1d70fc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:41:46.449+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:41:46.460+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d6fef9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D6FED8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B4BC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D70BB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D709AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D706B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D7049D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D70280000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D6FED8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D70DB9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d6fef9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:41:46.460+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:42:46.577+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:42:46.584+0000 I CONTROL [initandlisten] MongoDB starting : pid=28060 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:42:46.585+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:42:46.635+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:42:46.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783366:994914][28060:0x7effc0f98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:42:46.995+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:42:47.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7effbfec8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFBFEA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF75AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFC0B7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFC097B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFC0681000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFC046C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFC024F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFBFEA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFC0D88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7effbfec8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:42:47.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:43:46.147+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] MongoDB starting : pid=28306 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:43:46.154+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:43:46.155+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:43:46.155+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:43:46.205+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:43:46.557+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783426:557038][28306:0x7f8d32e58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:43:46.557+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:43:46.576+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d31d88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D31D67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB4CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D32A3F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D3283B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D32541000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D3232C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D3210F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D31D67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D32C48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d31d88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:43:46.576+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:44:46.695+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] MongoDB starting : pid=28517 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:44:46.702+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:44:46.752+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:44:47.113+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783487:112999][28517:0x7f8cd7c62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:44:47.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:44:47.123+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8cd6b92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8CD6B71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC285F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8CD7849000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8CD7645000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8CD734B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8CD7136000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8CD6F19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8CD6B71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8CD7A52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8cd6b92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:44:47.123+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:45:46.254+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] MongoDB starting : pid=28724 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:45:46.263+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:45:46.316+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:45:46.683+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783546:683915][28724:0x7f6b24d55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:45:46.684+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:45:46.705+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b23c85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B23C64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CCF2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B2493C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B24738000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B2443E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B24229000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B2400C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B23C64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B24B45000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b23c85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:45:46.705+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:46:46.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=28869 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:46:46.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:46:46.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:46:46.693+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783606:693203][28869:0x7f5c64c46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:46:46.693+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:46:46.703+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c63b76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C63B55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C6482D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C64629000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C6432F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C6411A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C63EFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C63B55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C64A36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c63b76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:46:46.703+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:47:46.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] MongoDB starting : pid=29155 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:47:46.829+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:47:46.878+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:47:47.249+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783667:249407][29155:0x7fb4805dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:47:47.249+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:47:47.268+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb47f50f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB47F4EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB4801C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB47FFC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB47FCC8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB47FAB3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB47F896000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB47F4EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB4803CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb47f50f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:47:47.269+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:48:46.395+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] MongoDB starting : pid=29391 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:48:46.402+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:48:46.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:48:46.793+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783726:793383][29391:0x7fb082e64c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:48:46.793+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:48:46.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb081d94635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB081D73000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF104FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB082A4B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB082847000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB08254D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB082338000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB08211B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB081D73000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB082C54000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb081d94635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:48:46.813+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:49:46.942+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] MongoDB starting : pid=29591 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:49:46.949+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:49:46.998+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:49:47.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783787:318263][29591:0x7f7acc0d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:49:47.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:49:47.328+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7acb008635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7ACAFE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7ACBCBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7ACBABB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7ACB7C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7ACB5AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7ACB38F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7ACAFE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7ACBEC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7acb008635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:49:47.328+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:50:46.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] MongoDB starting : pid=29793 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:50:46.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:50:46.507+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:50:46.872+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783846:872171][29793:0x7fa7ef370c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:50:46.872+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:50:46.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7ee2a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7EE27F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7EEF57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7EED53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7EEA59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7EE844000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7EE627000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7EE27F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7EF160000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7ee2a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:50:46.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:51:46.380+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] MongoDB starting : pid=29928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:51:46.388+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:51:46.441+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:51:46.739+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783906:739256][29928:0x7fe1fc4c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:51:46.739+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:51:46.749+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1fb3f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1FB3D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1FC0AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1FBEAA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1FBBB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1FB99B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1FB77E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1FB3D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1FC2B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1fb3f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:51:46.749+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:52:46.871+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] MongoDB starting : pid=30209 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:52:46.878+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:52:46.930+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:52:47.200+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507783967:200554][30209:0x7fb66789ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:52:47.200+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:52:47.211+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb6667ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB6667A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB667481000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB66727D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB666F83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB666D6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB666B51000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB6667A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB66768A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb6667ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:52:47.211+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:53:46.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] MongoDB starting : pid=30445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:53:46.349+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:53:46.398+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:53:46.686+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784026:686934][30445:0x7fd9597bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:53:46.686+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:53:46.697+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd9586ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD9586CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD9593A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD95919F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD958EA5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD958C90000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD958A73000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD9586CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD9595AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd9586ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:53:46.697+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:54:46.820+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=30646 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:54:46.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:54:46.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:54:47.249+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784087:249676][30646:0x7f8f04b97c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:54:47.249+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:54:47.268+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f03ac7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F03AA6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F0477E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F0457A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F04280000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F0406B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F03E4E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F03AA6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F04987000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f03ac7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:54:47.268+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:55:46.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] MongoDB starting : pid=30854 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:55:46.414+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:55:46.464+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:55:46.853+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784146:853961][30854:0x7fc425f93c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:55:46.854+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:55:46.875+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc424ec3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC424EA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BDDF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC425B7A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC425976000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC42567C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC425467000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC42524A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC424EA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC425D83000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc424ec3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:55:46.875+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:56:46.711+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] MongoDB starting : pid=30983 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:56:46.718+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:56:46.767+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:56:47.051+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784207:51432][30983:0x7f3e059ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:56:47.051+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:56:47.062+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e0492f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E0490E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E055E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E053E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E050E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E04ED3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E04CB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E0490E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E057EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e0492f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:56:47.062+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:57:46.209+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] MongoDB starting : pid=31275 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:57:46.216+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:57:46.266+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:57:46.544+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784266:544469][31275:0x7fdd39391c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:57:46.544+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:57:46.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd382c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD382A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD38F78000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD38D74000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD38A7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD38865000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD38648000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD382A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD39181000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd382c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:57:46.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:58:46.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] MongoDB starting : pid=31524 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:58:46.694+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:58:46.743+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:58:47.112+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784327:112943][31524:0x7fd99873dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:58:47.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:58:47.132+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd99766d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD99764C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA757E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD998324000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD998120000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD997E26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD997C11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD9979F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD99764C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD99852D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd99766d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:58:47.132+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T04:59:46.259+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=31746 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] modules: none 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] build environment: 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T04:59:46.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T04:59:46.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T04:59:46.698+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784386:698320][31746:0x7f04f3e32c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T04:59:46.698+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T04:59:46.718+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04f2d62635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04F2D41000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5000A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04F3A19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04F3815000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04F351B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04F3306000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04F30E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04F2D41000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04F3C22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04f2d62635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T04:59:46.718+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:00:46.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=31950 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:00:46.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:00:46.476+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:00:46.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784446:805947][31950:0x7f223b561c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:00:46.806+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:00:46.817+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f223a491635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F223A470000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F223B148000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F223AF44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F223AC4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F223AA35000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F223A818000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F223A470000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F223B351000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f223a491635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:00:46.817+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:01:46.094+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] MongoDB starting : pid=32079 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:01:46.102+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:01:46.152+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:01:46.508+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784506:508144][32079:0x7f5ad66a6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:01:46.508+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:01:46.518+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ad55d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AD55B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AD628D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AD6089000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AD5D8F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AD5B7A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AD595D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AD55B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AD6496000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ad55d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:01:46.518+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:02:46.127+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] MongoDB starting : pid=32231 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:02:46.134+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:02:46.135+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:02:46.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:02:46.539+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784566:539971][32231:0x7f0575f4ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:02:46.540+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:02:46.559+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0574e7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0574E5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F057685B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0575B33000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F057592F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0575635000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0575420000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0575203000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0574E5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0575D3C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0574e7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:02:46.559+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:03:46.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=32527 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:03:46.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:03:46.739+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:03:47.020+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784627:20379][32527:0x7f468f34fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:03:47.020+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:03:47.039+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f468e27f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F468E25E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF331E4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F468EF36000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F468ED32000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F468EA38000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F468E823000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F468E606000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F468E25E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F468F13F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f468e27f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:03:47.040+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:04:46.159+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] MongoDB starting : pid=32726 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:04:46.167+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:04:46.218+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:04:46.537+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784686:537241][32726:0x7f401ae29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:04:46.537+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:04:46.548+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4019d59635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4019D38000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7867B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F401AA10000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F401A80C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F401A512000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F401A2FD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F401A0E0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4019D38000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F401AC19000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4019d59635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:04:46.548+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:05:46.671+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=459 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:05:46.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:05:46.727+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:05:46.995+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784746:995012][459:0x7f922c8e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:05:46.995+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:05:47.005+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f922b816635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F922B7F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF85B7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F922C4CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F922C2C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F922BFCF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F922BDBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F922BB9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F922B7F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F922C6D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f922b816635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:05:47.005+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:06:46.279+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] MongoDB starting : pid=669 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:06:46.288+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:06:46.340+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:06:46.716+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784806:716918][669:0x7f626188fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:06:46.717+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:06:46.736+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62607bf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F626079E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8623000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6261476000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6261272000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6260F78000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6260D63000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6260B46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F626079E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F626167F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62607bf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:06:46.736+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:07:46.859+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] MongoDB starting : pid=815 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:07:46.867+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:07:46.918+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:07:47.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784867:218372][815:0x7f922b08cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:07:47.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:07:47.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9229fbc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9229F9B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F0E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F922AC73000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F922AA6F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F922A775000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F922A560000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F922A343000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9229F9B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F922AE7C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9229fbc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:07:47.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:08:46.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=1109 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:08:46.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:08:46.410+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:08:46.773+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784926:773350][1109:0x7f9ea1ea1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:08:46.773+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:08:46.784+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ea0dd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9EA0DB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9EA1A88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9EA1884000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9EA158A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9EA1375000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9EA1158000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9EA0DB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9EA1C91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ea0dd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:08:46.784+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:09:46.920+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] MongoDB starting : pid=1318 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:09:46.927+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:09:46.977+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:09:47.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507784987:305699][1318:0x7fdfc7f54c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:09:47.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:09:47.318+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdfc6e84635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFC6E63000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D4DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFC7B3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFC7937000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFC763D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFC7428000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFC720B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFC6E63000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFC7D44000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdfc6e84635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:09:47.318+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:10:46.434+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] MongoDB starting : pid=1525 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:10:46.442+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:10:46.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:10:46.829+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785046:829876][1525:0x7fb931e21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:10:46.829+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:10:46.841+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb930d51635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB930D30000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFC17000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB931A08000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB931804000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB93150A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB9312F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9310D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB930D30000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB931C11000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb930d51635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:10:46.841+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:11:46.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] MongoDB starting : pid=1743 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:11:46.736+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:11:46.786+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:11:47.103+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785107:103316][1743:0x7fd108418c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:11:47.103+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:11:47.114+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd107348635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD107327000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF240FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD107FFF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD107DFB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD107B01000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD1078EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD1076CF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD107327000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD108208000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd107348635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:11:47.114+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:12:46.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=1894 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:12:46.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:12:46.299+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:12:46.626+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785166:626501][1894:0x7f1c11732c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:12:46.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:12:46.636+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c10662635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C10641000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2CE8A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C11319000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C11115000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C10E1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C10C06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C109E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C10641000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C11522000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c10662635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:12:46.636+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:13:46.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] MongoDB starting : pid=2201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:13:46.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:13:46.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:13:47.113+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785227:113102][2201:0x7f2d84f2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:13:47.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:13:47.126+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d83e5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D83E3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D84B13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D8490F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D84615000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D84400000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D841E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D83E3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D84D1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d83e5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:13:47.126+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:14:46.234+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] MongoDB starting : pid=2414 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:14:46.241+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:14:46.291+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:14:46.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785286:661608][2414:0x7f08bc39ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:14:46.661+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:14:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f08bb2ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F08BB2A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF458FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F08BBF81000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F08BBD7D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F08BBA83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F08BB86E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F08BB651000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F08BB2A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F08BC18A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f08bb2ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:14:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:15:46.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:15:46.822+0000 I CONTROL [initandlisten] MongoDB starting : pid=2615 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:15:46.823+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:15:46.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:15:47.207+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785347:207167][2615:0x7fcf3ff19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:15:47.207+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:15:47.226+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf3ee49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF3EE28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD78A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF3FB00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF3F8FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF3F602000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF3F3ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF3F1D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF3EE28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF3FD09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf3ee49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:15:47.226+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:16:46.901+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:16:46.909+0000 I CONTROL [initandlisten] MongoDB starting : pid=2832 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:16:46.909+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:16:46.909+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:16:46.909+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:16:46.910+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:16:46.910+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:16:46.910+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:16:46.910+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:16:46.910+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:16:46.961+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:16:47.257+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785407:257610][2832:0x7fc6e288cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:16:47.257+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:16:47.268+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6e17bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6E179B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF293A7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6E2473000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6E226F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6E1F75000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6E1D60000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC6E1B43000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6E179B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC6E267C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6e17bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:16:47.268+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:17:46.390+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] MongoDB starting : pid=2989 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:17:46.397+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:17:46.448+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:17:46.748+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785466:748821][2989:0x7f02015f0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:17:46.748+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:17:46.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0200520635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F02004FF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFABAB0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F02011D7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0200FD3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0200CD9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0200AC4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02008A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F02004FF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F02013E0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0200520635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:17:46.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:18:46.880+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] MongoDB starting : pid=3281 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:18:46.887+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:18:46.938+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:18:47.253+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785527:253148][3281:0x7fadaf95dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:18:47.253+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:18:47.263+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fadae88d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FADAE86C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB256A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FADAF544000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FADAF340000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FADAF046000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FADAEE31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FADAEC14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FADAE86C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FADAF74D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fadae88d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:18:47.263+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:19:46.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] MongoDB starting : pid=3483 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:19:46.385+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:19:46.434+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:19:46.811+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785586:811668][3483:0x7fe156694c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:19:46.811+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:19:46.831+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1555c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1555A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE15627B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE156077000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE155D7D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE155B68000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE15594B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1555A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE156484000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1555c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:19:46.831+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:20:46.953+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] MongoDB starting : pid=3690 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:20:46.960+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:20:47.011+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:20:47.256+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785647:256064][3690:0x7ff0cf663c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:20:47.256+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:20:47.266+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff0ce593635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0CE572000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED4C6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF0CF24A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF0CF046000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF0CED4C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF0CEB37000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF0CE91A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0CE572000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF0CF453000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff0ce593635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:20:47.266+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:21:46.189+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] MongoDB starting : pid=3903 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:21:46.199+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:21:46.200+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:21:46.249+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:21:46.512+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785706:512383][3903:0x7f5e2b13fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:21:46.512+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:21:46.523+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e2a06f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E2A04E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13768000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E2AD26000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E2AB22000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E2A828000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E2A613000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E2A3F6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E2A04E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E2AF2F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e2a06f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:21:46.523+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:22:46.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] MongoDB starting : pid=4048 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:22:46.662+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:22:46.713+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:22:47.027+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785767:27622][4048:0x7f94c4a98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:22:47.027+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:22:47.038+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94c39c8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F94C39A7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFBCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F94C467F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F94C447B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F94C4181000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F94C3F6C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F94C3D4F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F94C39A7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94C4888000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94c39c8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:22:47.038+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:23:46.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=4336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:23:46.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:23:46.225+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:23:46.495+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785826:495592][4336:0x7feae0979c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:23:46.495+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:23:46.506+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feadf8a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEADF888000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB24FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEAE0560000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEAE035C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEAE0062000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEADFE4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEADFC30000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEADF888000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEAE0769000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feadf8a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:23:46.506+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:24:46.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=4546 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:24:46.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:24:46.679+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:24:47.009+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785887:9435][4546:0x7f33943adc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:24:47.009+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:24:47.019+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33932dd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33932BC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD740C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3393F94000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3393D90000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3393A96000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3393881000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3393664000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33932BC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F339419D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33932dd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:24:47.019+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:25:46.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] MongoDB starting : pid=4757 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:25:46.149+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:25:46.204+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:25:46.553+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507785946:553521][4757:0x7f87c7d10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:25:46.553+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:25:46.574+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f87c6c40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87C6C1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF384B4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F87C78F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F87C76F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F87C73F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F87C71E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F87C6FC7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87C6C1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87C7B00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f87c6c40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:25:46.574+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:26:46.316+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] MongoDB starting : pid=5043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:26:46.324+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:26:46.374+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:26:46.704+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786006:704459][5043:0x7fdaefedfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:26:46.704+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:26:46.717+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdaeee0f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDAEEDEE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BC5B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDAEFAC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDAEF8C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDAEF5C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDAEF3B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDAEF196000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDAEEDEE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDAEFCCF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdaeee0f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:26:46.717+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:27:46.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] MongoDB starting : pid=5349 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:27:46.873+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:27:46.925+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:27:47.227+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786067:227983][5349:0x7f31404d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:27:47.228+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:27:47.238+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f313f401635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F313F3E0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF700FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F31400B8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F313FEB4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F313FBBA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F313F9A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F313F788000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F313F3E0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F31402C1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f313f401635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:27:47.238+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:28:46.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=5888 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:28:46.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:28:46.429+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:28:46.719+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786126:719821][5888:0x7f19c17c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:28:46.719+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:28:46.730+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19c06f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19C06D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8A51000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19C13A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19C11A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19C0EAB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19C0C96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19C0A79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19C06D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19C15B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19c06f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:28:46.730+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:29:46.850+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] MongoDB starting : pid=6174 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:29:46.857+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:29:46.907+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:29:47.220+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786187:220122][6174:0x7f2de9a53c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:29:47.220+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:29:47.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2de8983635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2DE8962000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E2DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2DE963A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2DE9436000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2DE913C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2DE8F27000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2DE8D0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2DE8962000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2DE9843000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2de8983635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:29:47.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:30:46.345+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=6495 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:30:46.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:30:46.402+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:30:46.734+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786246:734753][6495:0x7f4fd562ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:30:46.734+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:30:46.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4fd455e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4FD453D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D477000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4FD5215000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4FD5011000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4FD4D17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4FD4B02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4FD48E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4FD453D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4FD541E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4fd455e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:30:46.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:31:46.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] MongoDB starting : pid=6738 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:31:46.677+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:31:46.731+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:31:47.118+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786307:118371][6738:0x7f0216d56c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:31:47.118+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:31:47.138+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0215c86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0215C65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F021693D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0216739000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F021643F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F021622A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F021600D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0215C65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0216B46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0215c86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:31:47.138+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:32:46.278+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] MongoDB starting : pid=6887 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:32:46.286+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:32:46.337+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:32:46.675+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786366:675478][6887:0x7f8733815c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:32:46.675+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:32:46.686+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8732745635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8732724000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF216E4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F87333FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F87331F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8732EFE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8732CE9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8732ACC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8732724000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8733605000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8732745635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:32:46.686+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:33:46.810+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=7176 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:33:46.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:33:46.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:33:47.230+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786427:230550][7176:0x7fbbedb01c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:33:47.230+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:33:47.241+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbbeca31635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBBECA10000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC70FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBBED6E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBBED4E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBBED1EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBBECFD5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBBECDB8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBBECA10000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBBED8F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbbeca31635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:33:47.241+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:34:46.369+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:34:46.376+0000 I CONTROL [initandlisten] MongoDB starting : pid=7378 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:34:46.377+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:34:46.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:34:46.720+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786486:720332][7378:0x7fc6f2f9dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:34:46.720+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:34:46.731+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6f1ecd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6F1EAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEDBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6F2B84000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6F2980000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6F2686000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6F2471000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC6F2254000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6F1EAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC6F2D8D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6f1ecd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:34:46.731+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:35:46.862+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] MongoDB starting : pid=7577 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:35:46.869+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:35:46.919+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:35:47.192+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786547:192755][7577:0x7f5ebce9bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:35:47.192+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:35:47.203+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ebbdcb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5EBBDAA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B647000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EBCA82000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EBC87E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EBC584000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5EBC36F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5EBC152000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5EBBDAA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EBCC8B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ebbdcb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:35:47.203+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:36:46.823+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] MongoDB starting : pid=7783 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:36:46.831+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:36:46.881+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:36:47.145+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786607:145525][7783:0x7fa6cecd4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:36:47.145+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:36:47.155+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6cdc04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6CDBE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6CE8BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6CE6B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6CE3BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6CE1A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6CDF8B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6CDBE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6CEAC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6cdc04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:36:47.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:37:46.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] MongoDB starting : pid=7927 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:37:46.290+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:37:46.340+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:37:46.658+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786666:658119][7927:0x7ff56fd61c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:37:46.658+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:37:46.678+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff56ec91635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF56EC70000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0A2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF56F948000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF56F744000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF56F44A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF56F235000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF56F018000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF56EC70000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF56FB51000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff56ec91635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:37:46.678+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:38:46.803+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=8097 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:38:46.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:38:46.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:38:47.140+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786727:140441][8097:0x7f02771ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:38:47.140+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:38:47.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f027612f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F027610E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF142B5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0276DE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0276BE2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F02768E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02766D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02764B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F027610E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0276FEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f027612f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:38:47.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:39:46.274+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] MongoDB starting : pid=8329 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:39:46.281+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:39:46.331+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:39:46.621+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786786:621402][8329:0x7f9061f35c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:39:46.621+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:39:46.631+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9060e65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9060E44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9061B1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9061918000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F906161E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9061409000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90611EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9060E44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9061D25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9060e65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:39:46.631+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:40:46.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] MongoDB starting : pid=8546 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:40:46.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:40:46.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:40:47.094+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786847:94048][8546:0x7f8852d0fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:40:47.094+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:40:47.105+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8851c3f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8851C1E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF432FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F88528F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88526F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88523F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88521E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8851FC6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8851C1E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8852AFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8851c3f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:40:47.105+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:41:47.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] MongoDB starting : pid=8757 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:41:47.043+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:41:47.096+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:41:47.379+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786907:379908][8757:0x7f7c40b29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:41:47.379+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:41:47.390+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c3fa59635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C3FA38000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF572FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C40710000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C4050C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C40212000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C3FFFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C3FDE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C3FA38000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C40919000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c3fa59635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:41:47.390+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:42:46.516+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] MongoDB starting : pid=8989 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:42:46.524+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:42:46.574+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:42:46.880+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507786966:880097][8989:0x7f25bd726c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:42:46.880+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:42:46.890+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25bc656635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25BC635000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25BD30D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F25BD109000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25BCE0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25BCBFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25BC9DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25BC635000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25BD516000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25bc656635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:42:46.890+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:43:47.014+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] MongoDB starting : pid=9160 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:43:47.022+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:43:47.072+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:43:47.415+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787027:415163][9160:0x7f716678fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:43:47.415+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:43:47.425+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f71656bf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F716569E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE94FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7166376000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7166172000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7165E78000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7165C63000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7165A46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F716569E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F716657F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f71656bf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:43:47.425+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:44:46.549+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] MongoDB starting : pid=9411 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:44:46.556+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:44:46.607+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:44:46.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787086:894577][9411:0x7f5c5485fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:44:46.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:44:46.905+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c5378f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C5376E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C54446000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C54242000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C53F48000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C53D33000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C53B16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C5376E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C5464F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c5378f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:44:46.905+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:45:47.028+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] MongoDB starting : pid=9612 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:45:47.036+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:45:47.088+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:45:47.437+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787147:437051][9612:0x7ffc13a30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:45:47.437+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:45:47.448+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc12960635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC1293F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC13617000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC13413000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC13119000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC12F04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC12CE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC1293F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC13820000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc12960635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:45:47.448+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:46:46.318+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] MongoDB starting : pid=9817 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:46:46.326+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:46:46.376+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:46:46.649+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787206:649410][9817:0x7f1247899c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:46:46.649+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:46:46.659+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12467c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12467A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1247480000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F124727C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1246F82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1246D6D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1246B50000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12467A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1247689000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12467c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:46:46.659+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:47:46.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] MongoDB starting : pid=10051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:47:46.794+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:47:46.846+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:47:47.134+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787267:134006][10051:0x7f58c543ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:47:47.134+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:47:47.144+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58c436e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58C434D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58C5025000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58C4E21000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58C4B27000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58C4912000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58C46F5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58C434D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58C522E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58c436e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:47:47.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:48:46.266+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] MongoDB starting : pid=10205 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:48:46.273+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:48:46.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:48:46.597+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787326:597247][10205:0x7fc0dd49cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:48:46.597+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:48:46.608+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc0dc3cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC0DC3AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1C87A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC0DD083000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC0DCE7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC0DCB85000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC0DC970000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC0DC753000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC0DC3AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC0DD28C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc0dc3cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:48:46.608+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:49:46.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] MongoDB starting : pid=10460 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:49:46.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:49:46.785+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:49:47.151+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787387:151400][10460:0x7f59f3924c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:49:47.151+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:49:47.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59f2854635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59F2833000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59F350B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59F3307000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59F300D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59F2DF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59F2BDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59F2833000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59F3714000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59f2854635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:49:47.162+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:50:46.286+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=10671 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:50:46.294+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:50:46.345+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:50:46.689+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787446:689678][10671:0x7ff948fe0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:50:46.689+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:50:46.700+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff947f10635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF947EEF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD06A1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF948BC7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9489C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9486C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9484B4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF948297000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF947EEF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF948DD0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff947f10635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:50:46.700+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:51:46.547+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] MongoDB starting : pid=10885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:51:46.554+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:51:46.605+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:51:46.976+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787506:976734][10885:0x7fac465fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:51:46.976+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:51:46.996+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac4552a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC45509000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC461E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC45FDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC45CE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC45ACE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC458B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC45509000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC463EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac4552a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:51:46.996+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:52:46.124+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] MongoDB starting : pid=11115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:52:46.131+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:52:46.181+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:52:46.537+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787566:537226][11115:0x7f4630b1cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:52:46.537+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:52:46.547+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f462fa4c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F462FA2B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4630703000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F46304FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4630205000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F462FFF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F462FDD3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F462FA2B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F463090C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f462fa4c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:52:46.547+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:53:46.671+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=11268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:53:46.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:53:46.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:53:47.090+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787627:90385][11268:0x7fe2dc044c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:53:47.090+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:53:47.110+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2daf74635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2DAF53000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66CF0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2DBC2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2DBA27000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2DB72D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2DB518000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2DB2FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2DAF53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2DBE34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2daf74635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:53:47.110+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:54:46.244+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=11520 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:54:46.251+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:54:46.302+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:54:46.676+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787686:676250][11520:0x7f3708565c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:54:46.676+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:54:46.696+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3707495635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3707474000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF442FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F370814C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3707F48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3707C4E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3707A39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F370781C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3707474000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3708355000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3707495635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:54:46.696+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:55:46.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] MongoDB starting : pid=11720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:55:46.833+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:55:46.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:55:47.225+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787747:225134][11720:0x7ff3677e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:55:47.225+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:55:47.244+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff366712635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3666F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF232FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3673C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3671C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF366ECB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF366CB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF366A99000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3666F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3675D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff366712635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:55:47.244+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:56:46.672+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] MongoDB starting : pid=11936 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:56:46.679+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:56:46.729+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:56:47.073+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787807:73247][11936:0x7ff85f4d4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:56:47.073+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:56:47.084+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff85e404635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF85E3E3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3759D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF85F0BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF85EEB7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF85EBBD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF85E9A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF85E78B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF85E3E3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF85F2C4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff85e404635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:56:47.084+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:57:46.209+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] MongoDB starting : pid=12170 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:57:46.216+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:57:46.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:57:46.574+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787866:574377][12170:0x7faa64dcdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:57:46.574+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:57:46.594+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa63cfd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA63CDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04472000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA649B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA647B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA644B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA642A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA64084000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA63CDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA64BBD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa63cfd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:57:46.594+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:58:46.722+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] MongoDB starting : pid=12340 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:58:46.729+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:58:46.779+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:58:47.049+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787927:49544][12340:0x7fc796d22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:58:47.049+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:58:47.060+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc795c52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC795C31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC796909000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC796705000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC79640B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7961F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC795FD9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC795C31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC796B12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc795c52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:58:47.060+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T05:59:46.174+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] MongoDB starting : pid=12596 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] modules: none 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] build environment: 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T05:59:46.181+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T05:59:46.230+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T05:59:46.529+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507787986:529331][12596:0x7fe522958c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T05:59:46.529+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T05:59:46.539+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe521888635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE521867000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE52253F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE52233B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE522041000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE521E2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE521C0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE521867000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE522748000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe521888635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T05:59:46.539+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:00:46.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=12854 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:00:46.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:00:46.884+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:00:47.223+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788047:223341][12854:0x7f59bb12cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:00:47.223+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:00:47.242+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59ba05c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59BA03B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59BAD13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59BAB0F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59BA815000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59BA600000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59BA3E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59BA03B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59BAF1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59ba05c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:00:47.242+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:01:46.692+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:01:46.699+0000 I CONTROL [initandlisten] MongoDB starting : pid=13060 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:01:46.699+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:01:46.699+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:01:46.700+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:01:46.700+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:01:46.700+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:01:46.700+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:01:46.700+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:01:46.700+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:01:46.750+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:01:47.008+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788107:8326][13060:0x7f8b2ed76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:01:47.008+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:01:47.019+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b2dca6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B2DC85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B2E95D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B2E759000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B2E45F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B2E24A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B2E02D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B2DC85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B2EB66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b2dca6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:01:47.019+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:02:46.071+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] MongoDB starting : pid=13288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:02:46.078+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:02:46.128+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:02:46.421+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788166:421490][13288:0x7f23fd91cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:02:46.421+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:02:46.432+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f23fc84c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F23FC82B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF923B8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F23FD503000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F23FD2FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F23FD005000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F23FCDF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F23FCBD3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F23FC82B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F23FD70C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f23fc84c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:02:46.432+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:03:46.566+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] MongoDB starting : pid=13451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:03:46.576+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:03:46.626+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:03:46.913+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788226:913888][13451:0x7fde16a5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:03:46.913+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:03:46.924+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde1598f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE1596E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8BCC1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE16646000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE16442000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE16148000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE15F33000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE15D16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE1596E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE1684F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde1598f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:03:46.924+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:04:46.051+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] MongoDB starting : pid=13712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:04:46.058+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:04:46.107+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:04:46.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788286:410977][13712:0x7f459b125c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:04:46.411+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:04:46.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f459a055635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F459A034000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF30CCB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F459AD0C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F459AB08000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F459A80E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F459A5F9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F459A3DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F459A034000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F459AF15000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f459a055635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:04:46.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:05:46.547+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] MongoDB starting : pid=13914 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:05:46.554+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:05:46.604+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:05:46.877+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788346:877027][13914:0x7f241625fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:05:46.877+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:05:46.888+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f241518f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F241516E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF55AED000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2415E46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2415C42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2415948000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2415733000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2415516000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F241516E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F241604F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f241518f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:05:46.888+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:06:46.300+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] MongoDB starting : pid=14119 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:06:46.307+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:06:46.357+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:06:46.667+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788406:667491][14119:0x7f98f9200c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:06:46.667+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:06:46.678+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98f8130635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98F810F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98F8DE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98F8BE3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98F88E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98F86D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98F84B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98F810F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98F8FF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98f8130635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:06:46.678+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:07:46.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] MongoDB starting : pid=14349 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:07:46.383+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:07:46.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:07:46.701+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788466:701744][14349:0x7f6b0ec09c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:07:46.701+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:07:46.712+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b0db39635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B0DB18000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC72FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B0E7F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B0E5EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B0E2F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B0E0DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B0DEC0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B0DB18000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B0E9F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b0db39635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:07:46.712+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:08:46.850+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=14834 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:08:46.862+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:08:46.915+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:08:47.234+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788527:234607][14834:0x7f0499afec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:08:47.234+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:08:47.245+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0498a2e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0498A0D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF310FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04996E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04994E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04991E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0498FD2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0498DB5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0498A0D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04998EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0498a2e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:08:47.245+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:09:46.366+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=15134 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:09:46.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:09:46.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:09:46.746+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788586:746509][15134:0x7f7ccfb08c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:09:46.746+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:09:46.757+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ccea38635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CCEA17000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CCF6EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CCF4EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CCF1F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CCEFDC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CCEDBF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CCEA17000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CCF8F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ccea38635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:09:46.757+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:10:46.889+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] MongoDB starting : pid=15338 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:10:46.896+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:10:46.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:10:47.278+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788647:278765][15338:0x7fb3694a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:10:47.278+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:10:47.292+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb3683d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB3683B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB369089000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB368E85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB368B8B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB368976000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB368759000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB3683B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB369292000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb3683d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:10:47.292+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:11:46.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=15557 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:11:46.758+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:11:46.808+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:11:47.181+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788707:181133][15557:0x7ff156a7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:11:47.181+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:11:47.201+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1559ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF15598C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD677A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF156664000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF156460000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF156166000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF155F51000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF155D34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF15598C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF15686D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1559ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:11:47.201+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:12:46.610+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] MongoDB starting : pid=15856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:12:46.618+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:12:46.668+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:12:46.946+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788766:946157][15856:0x7ff473281c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:12:46.946+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:12:46.956+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff4721b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF472190000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB8E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF472E68000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF472C64000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF47296A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF472755000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF472538000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF472190000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF473071000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff4721b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:12:46.956+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:13:46.110+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] MongoDB starting : pid=16024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:13:46.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:13:46.167+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:13:46.498+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788826:498130][16024:0x7ffeb8305c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:13:46.498+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:13:46.517+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffeb7235635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFEB7214000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE46FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFEB7EEC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFEB7CE8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFEB79EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFEB77D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFEB75BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFEB7214000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFEB80F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffeb7235635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:13:46.517+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:14:46.647+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:14:46.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=16145 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:14:46.655+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:14:46.706+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:14:47.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788887:19857][16145:0x7f32e6cdac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:14:47.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:14:47.032+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32e5c0a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F32E5BE9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F78D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F32E68C1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F32E66BD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F32E63C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F32E61AE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F32E5F91000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F32E5BE9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F32E6ACA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32e5c0a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:14:47.032+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:15:46.162+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] MongoDB starting : pid=16455 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:15:46.170+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:15:46.219+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:15:46.529+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507788946:529949][16455:0x7f62eb7bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:15:46.530+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:15:46.540+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62ea6eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62EA6CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF910FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62EB3A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62EB19E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62EAEA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62EAC8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62EAA72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62EA6CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62EB5AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62ea6eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:15:46.540+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:16:46.949+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] MongoDB starting : pid=16659 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:16:46.956+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:16:47.008+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:16:47.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789007:306625][16659:0x7f30ef92ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:16:47.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:16:47.323+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30ee85e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F30EE83D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2477D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F30EF515000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F30EF311000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F30EF017000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F30EEE02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F30EEBE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F30EE83D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F30EF71E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30ee85e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:16:47.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:17:46.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=16893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:17:46.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:17:47.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:17:47.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789067:305386][16893:0x7fda7bcbbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:17:47.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:17:47.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda7abeb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA7ABCA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56E03000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA7B8A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA7B69E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA7B3A4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA7B18F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA7AF72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA7ABCA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA7BAAB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda7abeb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:17:47.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:18:46.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] MongoDB starting : pid=17138 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:18:46.457+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:18:46.506+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:18:46.875+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789126:875359][17138:0x7fef3f478c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:18:46.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:18:46.895+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef3e3a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF3E387000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58052000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF3F05F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF3EE5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF3EB61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF3E94C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF3E72F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF3E387000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF3F268000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef3e3a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:18:46.895+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:19:47.019+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] MongoDB starting : pid=17254 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:19:47.027+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:19:47.076+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:19:47.341+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789187:341086][17254:0x7fd4455f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:19:47.341+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:19:47.351+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd444527635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD444506000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD4451DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD444FDA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD444CE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD444ACB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD4448AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD444506000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4453E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd444527635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:19:47.351+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:20:46.475+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] MongoDB starting : pid=17506 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:20:46.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:20:46.533+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:20:46.876+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789246:876701][17506:0x7fdd02888c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:20:46.876+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:20:46.896+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd017b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD01797000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "800000373000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD0246F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD0226B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD01F71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD01D5C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD01B3F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD01797000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD02678000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd017b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:20:46.896+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:21:46.327+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] MongoDB starting : pid=17714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:21:46.334+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:21:46.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:21:46.384+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:21:46.726+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789306:726443][17714:0x7f38e60cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:21:46.726+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:21:46.737+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f38e4ffa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38E4FD9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0A62000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F38E5CB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38E5AAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F38E57B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F38E559E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38E5381000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38E4FD9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38E5EBA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f38e4ffa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:21:46.737+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:22:46.798+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=17935 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:22:46.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:22:46.855+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:22:47.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789367:161163][17935:0x7f401512ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:22:47.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:22:47.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f401405a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4014039000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4014D11000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4014B0D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4014813000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40145FE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40143E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4014039000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4014F1A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f401405a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:22:47.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:23:46.294+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] MongoDB starting : pid=18182 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:23:46.301+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:23:46.351+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:23:46.607+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789426:607083][18182:0x7fcec8860c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:23:46.607+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:23:46.617+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcec7790635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCEC776F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B4C5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCEC8447000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCEC8243000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCEC7F49000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCEC7D34000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCEC7B17000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCEC776F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCEC8650000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcec7790635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:23:46.617+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:24:46.757+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] MongoDB starting : pid=18300 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:24:46.764+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:24:46.815+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:24:47.089+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789487:89300][18300:0x7f691f74bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:24:47.089+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:24:47.099+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f691e67b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F691E65A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F691F332000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F691F12E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F691EE34000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F691EC1F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F691EA02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F691E65A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F691F53B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f691e67b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:24:47.099+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:25:46.233+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] MongoDB starting : pid=18548 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:25:46.240+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:25:46.241+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:25:46.290+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:25:46.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789546:662179][18548:0x7f1670472c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:25:46.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:25:46.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f166f3a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F166F381000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF758FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1670059000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F166FE55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F166FB5B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F166F946000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F166F729000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F166F381000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1670262000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f166f3a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:25:46.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:26:46.089+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:26:46.096+0000 I CONTROL [initandlisten] MongoDB starting : pid=18755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:26:46.096+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:26:46.096+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:26:46.096+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:26:46.097+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:26:46.097+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:26:46.097+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:26:46.097+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:26:46.097+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:26:46.146+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:26:46.520+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789606:520159][18755:0x7f91d8aacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:26:46.520+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:26:46.540+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91d79dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91D79BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84CCA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F91D8693000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F91D848F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F91D8195000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F91D7F80000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F91D7D63000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91D79BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91D889C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91d79dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:26:46.540+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:27:46.187+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:27:46.194+0000 I CONTROL [initandlisten] MongoDB starting : pid=18978 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:27:46.194+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:27:46.194+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:27:46.194+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:27:46.195+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:27:46.195+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:27:46.195+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:27:46.195+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:27:46.195+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:27:46.246+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:27:46.655+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789666:655383][18978:0x7f324f895c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:27:46.655+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:27:46.675+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f324e7c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F324E7A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF880FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F324F47C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F324F278000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F324EF7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F324ED69000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F324EB4C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F324E7A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F324F685000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f324e7c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:27:46.675+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:28:46.803+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=19237 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:28:46.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:28:46.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:28:47.144+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789727:144653][19237:0x7fb0a8e29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:28:47.144+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:28:47.164+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0a7d59635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0A7D38000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF78198000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0A8A10000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0A880C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0A8512000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0A82FD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0A80E0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0A7D38000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0A8C19000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0a7d59635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:28:47.164+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:29:46.291+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] MongoDB starting : pid=19353 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:29:46.298+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:29:46.347+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:29:46.611+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789786:611951][19353:0x7f1e6083fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:29:46.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:29:46.622+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e5f76f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E5F74E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E60426000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E60222000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E5FF28000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E5FD13000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E5FAF6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E5F74E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E6062F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e5f76f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:29:46.622+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:30:46.756+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] MongoDB starting : pid=19618 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:30:46.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:30:46.815+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:30:47.184+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789847:184486][19618:0x7fc5ab17cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:30:47.184+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:30:47.203+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc5aa0ac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC5AA08B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9EA0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC5AAD63000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC5AAB5F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC5AA865000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC5AA650000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC5AA433000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC5AA08B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC5AAF6C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc5aa0ac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:30:47.203+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:31:46.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=19829 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:31:46.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:31:46.665+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:31:47.032+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789907:32648][19829:0x7f666ac08c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:31:47.032+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:31:47.052+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6669b38635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6669B17000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF816FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F666A7EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F666A5EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F666A2F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F666A0DC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6669EBF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6669B17000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F666A9F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6669b38635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:31:47.052+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:32:46.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=20054 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:32:46.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:32:46.429+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:32:46.758+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507789966:758235][20054:0x7f95539a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:32:46.758+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:32:46.768+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f95528d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F95528B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F955358E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F955338A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9553090000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9552E7B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9552C5E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F95528B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9553797000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f95528d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:32:46.768+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:33:46.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=20303 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:33:46.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:33:46.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:33:47.281+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790027:281831][20303:0x7f757cff6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:33:47.281+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:33:47.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f757bf26635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F757BF05000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F757CBDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F757C9D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F757C6DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F757C4CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F757C2AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F757BF05000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F757CDE6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f757bf26635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:33:47.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:34:46.427+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=20420 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:34:46.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:34:46.484+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:34:46.756+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790086:756602][20420:0x7f7cbd22ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:34:46.756+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:34:46.775+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7cbc15e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CBC13D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF76D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CBCE15000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CBCC11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CBC917000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CBC702000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CBC4E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CBC13D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CBD01E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7cbc15e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:34:46.775+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:35:46.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=20680 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:35:46.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:35:46.957+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:35:47.226+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790147:226767][20680:0x7f85cc04ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:35:47.226+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:35:47.237+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f85caf7a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F85CAF59000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08EA5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F85CBC31000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F85CBA2D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F85CB733000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F85CB51E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F85CB301000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F85CAF59000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F85CBE3A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f85caf7a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:35:47.237+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:36:46.631+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=20889 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:36:46.639+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:36:46.688+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:36:46.972+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790206:972478][20889:0x7f739f3bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:36:46.972+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:36:46.991+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f739e2ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F739E2C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F739EFA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F739ED9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F739EAA3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F739E88E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F739E671000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F739E2C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F739F1AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f739e2ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:36:46.991+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:37:46.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=21133 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:37:46.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:37:46.680+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:37:47.047+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790267:47192][21133:0x7f91422b7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:37:47.047+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:37:47.067+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91411e7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91411C6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD14FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9141E9E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9141C9A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F91419A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F914178B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F914156E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91411C6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91420A7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91411e7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:37:47.067+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:38:46.186+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] MongoDB starting : pid=21380 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:38:46.193+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:38:46.242+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:38:46.482+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790326:482283][21380:0x7f7a1b6dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:38:46.482+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:38:46.492+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a1a60b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A1A5EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BA26000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A1B2C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A1B0BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A1ADC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A1ABAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A1A992000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A1A5EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A1B4CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a1a60b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:38:46.492+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:39:46.613+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] MongoDB starting : pid=21498 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:39:46.621+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:39:46.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:39:47.006+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790387:6524][21498:0x7fa676bafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:39:47.006+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:39:47.026+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa675adf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA675ABE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DCCF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA676796000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA676592000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA676298000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA676083000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA675E66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA675ABE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA67699F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa675adf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:39:47.026+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:40:46.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] MongoDB starting : pid=21761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:40:46.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:40:46.209+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:40:46.593+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790446:593982][21761:0x7f9c37a7ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:40:46.594+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:40:46.604+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c369aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C36989000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88DF5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C37661000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C3745D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C37163000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C36F4E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C36D31000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C36989000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C3786A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c369aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:40:46.604+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:41:47.009+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] MongoDB starting : pid=21986 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:41:47.017+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:41:47.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:41:47.464+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790507:464930][21986:0x7f503d2a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:41:47.465+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:41:47.484+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f503c1d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F503C1B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF042FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F503CE89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F503CC85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F503C98B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F503C776000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F503C559000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F503C1B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F503D092000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f503c1d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:41:47.484+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:42:46.862+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] MongoDB starting : pid=22219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:42:46.870+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:42:46.920+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:42:47.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790567:291133][22219:0x7f5c92023c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:42:47.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:42:47.311+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c90f53635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C90F32000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62E69000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C91C0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C91A06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C9170C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C914F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C912DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C90F32000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C91E13000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c90f53635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:42:47.311+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:43:46.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] MongoDB starting : pid=22477 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:43:46.447+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:43:46.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:43:46.808+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790626:808844][22477:0x7fb379ec5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:43:46.808+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:43:46.820+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb378df5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB378DD4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA427000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB379AAC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB3798A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB3795AE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB379399000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB37917C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB378DD4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB379CB5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb378df5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:43:46.820+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:44:46.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:44:46.954+0000 I CONTROL [initandlisten] MongoDB starting : pid=22596 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:44:46.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:44:47.004+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:44:47.343+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790687:343356][22596:0x7f0da7380c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:44:47.343+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:44:47.359+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0da62b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0DA628F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFABEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0DA6F67000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0DA6D63000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0DA6A69000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0DA6854000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0DA6637000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0DA628F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0DA7170000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0da62b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:44:47.359+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:45:46.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=22845 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:45:46.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:45:46.548+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:45:46.921+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790746:921260][22845:0x7fd744cfac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:45:46.921+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:45:46.932+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd743c2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD743C09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7448E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7446DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7443E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7441CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD743FB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD743C09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD744AEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd743c2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:45:46.932+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:46:46.367+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=23051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:46:46.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:46:46.428+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:46:46.822+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790806:822314][23051:0x7f29c2e47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:46:46.822+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:46:46.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29c1d77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29C1D56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D099000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29C2A2E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29C282A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29C2530000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29C231B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29C20FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29C1D56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29C2C37000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29c1d77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:46:46.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:47:47.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=23271 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:47:47.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:47:47.116+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:47:47.441+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790867:441628][23271:0x7f071c15ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:47:47.441+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:47:47.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f071b08e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F071B06D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79860000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F071BD45000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F071BB41000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F071B847000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F071B632000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F071B415000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F071B06D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F071BF4E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f071b08e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:47:47.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:48:46.579+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] MongoDB starting : pid=23512 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:48:46.586+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:48:46.636+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:48:46.958+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790926:958078][23512:0x7f9e3f171c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:48:46.958+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:48:46.977+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e3e0a1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E3E080000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E3ED58000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E3EB54000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E3E85A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E3E645000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E3E428000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E3E080000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E3EF61000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e3e0a1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:48:46.977+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:49:46.111+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] MongoDB starting : pid=23633 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:49:46.119+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:49:46.170+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:49:46.568+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507790986:568595][23633:0x7f7f3338dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:49:46.568+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:49:46.587+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f322bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F3229C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F98C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F32F74000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F32D70000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F32A76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F32861000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F32644000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F3229C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F3317D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f322bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:49:46.587+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:50:46.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] MongoDB starting : pid=23761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:50:46.715+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:50:46.767+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:50:47.127+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791047:127183][23761:0x7ff610601c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:50:47.127+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:50:47.146+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff60f531635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF60F510000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF6101E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF60FFE4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF60FCEA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF60FAD5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF60F8B8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF60F510000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF6103F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff60f531635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:50:47.146+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:51:46.591+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=24023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:51:46.598+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:51:46.651+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:51:46.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791106:963860][24023:0x7fdd509cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:51:46.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:51:46.983+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd4f8ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD4F8DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD505B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD503B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD500B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD4FEA3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD4FC86000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD4F8DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD507BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd4f8ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:51:46.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:52:46.239+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] MongoDB starting : pid=24245 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:52:46.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:52:46.296+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:52:46.635+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791166:635984][24245:0x7ff61bd33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:52:46.636+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:52:46.646+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff61ac63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF61AC42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFABAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF61B91A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF61B716000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF61B41C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF61B207000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF61AFEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF61AC42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF61BB23000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff61ac63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:52:46.646+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:53:46.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] MongoDB starting : pid=24483 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:53:46.783+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:53:46.835+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:53:47.216+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791227:216263][24483:0x7fe2cd937c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:53:47.216+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:53:47.236+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2cc867635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2CC846000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2CD51E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2CD31A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2CD020000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2CCE0B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2CCBEE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2CC846000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2CD727000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2cc867635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:53:47.236+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:54:46.363+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] MongoDB starting : pid=24701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:54:46.370+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:54:46.419+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:54:46.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791286:724879][24701:0x7f106e3c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:54:46.724+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:54:46.744+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f106d2f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F106D2CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6229E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F106DFA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F106DDA3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F106DAA9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F106D894000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F106D677000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F106D2CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F106E1B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f106d2f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:54:46.744+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:55:46.871+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] MongoDB starting : pid=24817 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:55:46.879+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:55:46.929+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:55:47.297+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791347:297296][24817:0x7f76de402c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:55:47.297+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:55:47.307+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f76dd332635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F76DD311000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF282FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F76DDFE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F76DDDE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F76DDAEB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F76DD8D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F76DD6B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F76DD311000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F76DE1F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f76dd332635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:55:47.307+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:56:46.747+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] MongoDB starting : pid=25083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:56:46.756+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:56:46.813+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:56:47.203+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791407:203413][25083:0x7f9cc6697c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:56:47.203+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:56:47.222+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9cc55c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9CC55A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9CC627E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9CC607A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9CC5D80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9CC5B6B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9CC594E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9CC55A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9CC6487000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9cc55c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:56:47.222+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:57:46.403+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:57:46.411+0000 I CONTROL [initandlisten] MongoDB starting : pid=25308 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:57:46.411+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:57:46.411+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:57:46.411+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:57:46.411+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:57:46.411+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:57:46.412+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:57:46.412+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:57:46.412+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:57:46.463+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:57:46.835+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791466:835097][25308:0x7f167c858c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:57:46.835+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:57:46.854+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f167b788635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F167B767000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6128F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F167C43F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F167C23B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F167BF41000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F167BD2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F167BB0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F167B767000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F167C648000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f167b788635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:57:46.854+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:58:46.975+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] MongoDB starting : pid=25543 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:58:46.983+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:58:47.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:58:47.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791527:409184][25543:0x7f25743e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:58:47.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:58:47.429+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2573313635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25732F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16A2D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2573FCA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2573DC6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2573ACC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25738B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F257369A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25732F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25741D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2573313635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:58:47.429+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T06:59:46.575+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] MongoDB starting : pid=25776 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] modules: none 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] build environment: 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T06:59:46.583+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T06:59:46.633+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T06:59:46.983+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791586:983795][25776:0x7f022eb72c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T06:59:46.983+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T06:59:46.994+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f022daa2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F022DA81000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F022E759000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F022E555000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F022E25B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F022E046000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F022DE29000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F022DA81000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F022E962000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f022daa2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T06:59:46.994+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:00:46.129+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] MongoDB starting : pid=25893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:00:46.137+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:00:46.186+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:00:46.457+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791646:457113][25893:0x7f4fc064ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:00:46.457+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:00:46.469+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4fbf57a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4FBF559000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82DD8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4FC0231000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4FC002D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4FBFD33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4FBFB1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4FBF901000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4FBF559000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4FC043A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4fbf57a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:00:46.469+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:01:46.881+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:01:46.889+0000 I CONTROL [initandlisten] MongoDB starting : pid=26163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:01:46.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:01:46.943+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:01:47.376+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791707:376522][26163:0x7fe484d46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:01:47.376+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:01:47.396+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe483c76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE483C55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE48492D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE484729000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE48442F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE48421A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE483FFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE483C55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE484B36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe483c76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:01:47.396+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:02:46.507+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] MongoDB starting : pid=26388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:02:46.515+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:02:46.565+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:02:46.996+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791766:996692][26388:0x7ff85ce42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:02:46.996+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:02:47.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff85bd72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF85BD51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF85CA29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF85C825000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF85C52B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF85C316000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF85C0F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF85BD51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF85CC32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff85bd72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:02:47.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:03:46.150+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] MongoDB starting : pid=26603 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:03:46.157+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:03:46.207+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:03:46.647+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791826:647477][26603:0x7fde913ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:03:46.647+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:03:46.666+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde9030d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE902EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE90FC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE90DC0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE90AC6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE908B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE90694000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE902EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE911CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde9030d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:03:46.666+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:04:46.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=26836 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:04:46.798+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:04:46.848+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:04:47.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791887:274228][26836:0x7f9f1192ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:04:47.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:04:47.293+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9f1085e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9F1083D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9F11515000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9F11311000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9F11017000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9F10E02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9F10BE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9F1083D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9F1171E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9f1085e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:04:47.294+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:05:46.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] MongoDB starting : pid=26953 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:05:46.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:05:46.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:05:46.867+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507791946:867214][26953:0x7fcc2e63bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:05:46.867+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:05:46.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcc2d56b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCC2D54A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCC2E222000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCC2E01E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCC2DD24000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCC2DB0F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCC2D8F2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCC2D54A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCC2E42B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcc2d56b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:05:46.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:06:46.288+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] MongoDB starting : pid=27214 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:06:46.295+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:06:46.296+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:06:46.296+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:06:46.347+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:06:46.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792006:741430][27214:0x7f86f61a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:06:46.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:06:46.760+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86f50d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86F50B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC3EA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86F5D8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86F5B8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86F5891000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86F567C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86F545F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86F50B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86F5F98000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86f50d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:06:46.761+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:07:46.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] MongoDB starting : pid=27433 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:07:46.773+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:07:46.823+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:07:47.194+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792067:194470][27433:0x7f2dae454c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:07:47.194+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:07:47.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2dad384635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2DAD363000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2DAE03B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2DADE37000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2DADB3D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2DAD928000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2DAD70B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2DAD363000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2DAE244000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2dad384635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:07:47.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:08:46.334+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=27662 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:08:46.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:08:46.392+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:08:46.742+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792126:742903][27662:0x7f3bd8ecbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:08:46.742+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:08:46.753+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3bd7dfb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3BD7DDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF3F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BD8AB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BD88AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BD85B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BD839F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BD8182000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BD7DDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BD8CBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3bd7dfb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:08:46.753+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:09:46.872+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] MongoDB starting : pid=27891 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:09:46.879+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:09:46.929+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:09:47.275+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792187:275349][27891:0x7ffa03848c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:09:47.275+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:09:47.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa02778635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA02757000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA0342F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA0322B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA02F31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA02D1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA02AFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA02757000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA03638000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa02778635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:09:47.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:10:46.402+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] MongoDB starting : pid=28011 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:10:46.409+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:10:46.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:10:46.835+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792246:835873][28011:0x7f4261936c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:10:46.835+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:10:46.855+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4260866635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4260845000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD14FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F426151D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4261319000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F426101F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4260E0A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4260BED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4260845000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4261726000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4260866635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:10:46.855+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:11:46.271+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] MongoDB starting : pid=28272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:11:46.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:11:46.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:11:46.650+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792306:650498][28272:0x7f7f01b1bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:11:46.650+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:11:46.661+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f00a4b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F00A2A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43263000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F01702000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F014FE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F01204000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F00FEF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F00DD2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F00A2A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F0190B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f00a4b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:11:46.661+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:12:46.951+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=28493 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:12:46.958+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:12:47.010+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:12:47.397+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792367:397008][28493:0x7ff28a260c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:12:47.397+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:12:47.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff289190635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF28916F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF09AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF289E47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF289C43000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF289949000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF289734000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF289517000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF28916F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF28A050000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff289190635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:12:47.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:13:46.527+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=28728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:13:46.534+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:13:46.584+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:13:46.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792426:910547][28728:0x7f9c09c7ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:13:46.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:13:46.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c08bae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C08B8D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C09865000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C09661000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C09367000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C09152000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C08F35000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C08B8D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C09A6E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c08bae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:13:46.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:14:47.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] MongoDB starting : pid=28959 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:14:47.053+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:14:47.103+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:14:47.468+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792487:468774][28959:0x7fcf05e96c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:14:47.468+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:14:47.488+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf04dc6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF04DA5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD6EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF05A7D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF05879000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF0557F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF0536A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF0514D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF04DA5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF05C86000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf04dc6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:14:47.489+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:15:46.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] MongoDB starting : pid=29075 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:15:46.615+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:15:46.668+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:15:47.069+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792547:69439][29075:0x7fc8299c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:15:47.069+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:15:47.080+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8288f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8288D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE089000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8295AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8293A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8290AD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC828E98000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC828C7B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8288D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8297B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8288f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:15:47.080+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:16:46.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=29339 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:16:46.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:16:46.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:16:46.907+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792606:907773][29339:0x7fb6cf7f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:16:46.907+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:16:46.918+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb6ce721635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB6CE700000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62FF4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB6CF3D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB6CF1D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB6CEEDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB6CECC5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB6CEAA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB6CE700000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB6CF5E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb6ce721635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:16:46.918+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:17:46.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=29547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:17:46.294+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:17:46.295+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:17:46.295+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:17:46.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:17:46.689+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792666:689726][29547:0x7f393bd72c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:17:46.689+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:17:46.711+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f393aca2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F393AC81000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0A5B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F393B959000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F393B755000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F393B45B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F393B246000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F393B029000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F393AC81000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F393BB62000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f393aca2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:17:46.711+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:18:46.855+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=29781 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:18:46.862+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:18:46.912+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:18:47.181+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792727:181388][29781:0x7fdec2545c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:18:47.181+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:18:47.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdec1475635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDEC1454000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDEC212C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDEC1F28000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDEC1C2E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDEC1A19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDEC17FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDEC1454000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDEC2335000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdec1475635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:18:47.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:19:46.316+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] MongoDB starting : pid=30013 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:19:46.324+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:19:46.375+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:19:46.732+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792786:732373][30013:0x7f9b5b417c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:19:46.732+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:19:46.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b5a347635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B5A326000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B5AFFE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B5ADFA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B5AB00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B5A8EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B5A6CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B5A326000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B5B207000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b5a347635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:19:46.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:20:46.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=30130 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:20:46.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:20:46.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:20:47.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792847:291286][30130:0x7f6a7aea6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:20:47.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:20:47.310+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a79dd6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A79DB5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF058D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A7AA8D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A7A889000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A7A58F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A7A37A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A7A15D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A79DB5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A7AC96000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a79dd6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:20:47.310+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:21:46.756+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] MongoDB starting : pid=30392 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:21:46.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:21:46.814+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:21:47.093+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792907:93488][30392:0x7f919a4d3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:21:47.093+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:21:47.104+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9199403635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91993E2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF20EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F919A0BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9199EB6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9199BBC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F91999A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F919978A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91993E2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F919A2C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9199403635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:21:47.104+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:22:46.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=30593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:22:46.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:22:46.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:22:47.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507792967:370485][30593:0x7fc205812c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:22:47.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:22:47.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc204742635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC204721000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF942C3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC2053F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC2051F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC204EFB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC204CE6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC204AC9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC204721000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC205602000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc204742635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:22:47.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:23:46.511+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:23:46.518+0000 I CONTROL [initandlisten] MongoDB starting : pid=30828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:23:46.519+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:23:46.571+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:23:46.893+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793026:893172][30828:0x7fb64b136c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:23:46.893+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:23:46.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb64a066635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB64A045000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF3CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB64AD1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB64AB19000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB64A81F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB64A60A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB64A3ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB64A045000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB64AF26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb64a066635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:23:46.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:24:47.053+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] MongoDB starting : pid=31060 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:24:47.060+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:24:47.110+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:24:47.466+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793087:466679][31060:0x7f8f3da42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:24:47.466+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:24:47.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f3c972635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F3C951000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C576000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F3D629000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F3D425000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F3D12B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F3CF16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F3CCF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F3C951000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F3D832000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f3c972635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:24:47.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:25:46.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=31163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:25:46.601+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:25:46.651+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:25:47.028+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793147:28249][31163:0x7f4c53cfec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:25:47.028+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:25:47.047+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4c52c2e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4C52C0D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4C538E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4C536E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4C533E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4C531D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4C52FB5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4C52C0D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4C53AEE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4c52c2e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:25:47.047+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:26:46.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] MongoDB starting : pid=31284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:26:46.565+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:26:46.617+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:26:47.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793207:41838][31284:0x7fac63feec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:26:47.041+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:26:47.061+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac62f1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC62EFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E85B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC63BD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC639D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC636D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC634C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC632A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC62EFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC63DDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac62f1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:26:47.061+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:27:46.071+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:27:46.078+0000 I CONTROL [initandlisten] MongoDB starting : pid=31534 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:27:46.079+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:27:46.129+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:27:46.575+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793266:575540][31534:0x7f9103da4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:27:46.575+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:27:46.586+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9102cd4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9102CB3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25FB6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F910398B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9103787000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F910348D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9103278000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F910305B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9102CB3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9103B94000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9102cd4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:27:46.586+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:28:46.717+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] MongoDB starting : pid=31788 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:28:46.725+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:28:46.777+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:28:47.184+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793327:184134][31788:0x7fd94a23dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:28:47.184+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:28:47.203+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd94916d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD94914C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD949E24000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD949C20000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD949926000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD949711000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD9494F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD94914C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD94A02D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd94916d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:28:47.203+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:29:46.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=32024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:29:46.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:29:46.396+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:29:46.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793386:805631][32024:0x7f8dcf0c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:29:46.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:29:46.816+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8dcdff9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8DCDFD8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA50EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8DCECB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8DCEAAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8DCE7B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8DCE59D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8DCE380000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8DCDFD8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8DCEEB9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8dcdff9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:29:46.816+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:30:46.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] MongoDB starting : pid=32228 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:30:46.946+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:30:47.000+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:30:47.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793447:409885][32228:0x7ff724e2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:30:47.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:30:47.429+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff723d5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF723D3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D09E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF724A15000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF724811000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF724517000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF724302000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF7240E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF723D3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF724C1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff723d5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:30:47.429+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:31:46.827+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] MongoDB starting : pid=32345 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:31:46.838+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:31:46.891+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:31:47.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793507:338912][32345:0x7fa4fc82fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:31:47.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:31:47.358+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa4fb75f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA4FB73E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB6A3A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA4FC416000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA4FC212000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA4FBF18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA4FBD03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA4FBAE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA4FB73E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA4FC61F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa4fb75f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:31:47.358+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:32:46.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] MongoDB starting : pid=32598 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:32:46.492+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:32:46.543+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:32:46.907+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793566:907222][32598:0x7f56def84c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:32:46.907+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:32:46.920+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56ddeb4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56DDE93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56DEB6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56DE967000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56DE66D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56DE458000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56DE23B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56DDE93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56DED74000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56ddeb4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:32:46.920+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:33:46.296+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] MongoDB starting : pid=368 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:33:46.303+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:33:46.352+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:33:46.754+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793626:754952][368:0x7fe024433c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:33:46.755+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:33:46.774+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe023363635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE023342000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF30EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE02401A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE023E16000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE023B1C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE023907000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE0236EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE023342000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE024223000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe023363635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:33:46.774+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:34:46.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=623 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:34:46.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:34:46.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:34:47.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793687:287600][623:0x7f6a0c69ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:34:47.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:34:47.302+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a0b5ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A0B5A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4F6D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A0C281000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A0C07D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A0BD83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A0BB6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A0B951000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A0B5A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A0C48A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a0b5ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:34:47.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:35:46.426+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] MongoDB starting : pid=821 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:35:46.433+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:35:46.485+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:35:46.839+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793746:839891][821:0x7fada86d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:35:46.839+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:35:46.859+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fada7608635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FADA75E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FADA82BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FADA80BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FADA7DC1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FADA7BAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FADA798F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FADA75E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FADA84C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fada7608635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:35:46.859+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:36:46.278+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] MongoDB starting : pid=944 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:36:46.286+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:36:46.335+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:36:46.704+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793806:704226][944:0x7f06d4fddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:36:46.704+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:36:46.715+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f06d3f0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F06D3EEC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF09EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F06D4BC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F06D49C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F06D46C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F06D44B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F06D4294000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F06D3EEC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F06D4DCD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f06d3f0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:36:46.715+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:37:46.834+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] MongoDB starting : pid=1193 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:37:46.842+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:37:46.894+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:37:47.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793867:318780][1193:0x7f2e9c82fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:37:47.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:37:47.337+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e9b75f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E9B73E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC8FB0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E9C416000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E9C212000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E9BF18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E9BD03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E9BAE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E9B73E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E9C61F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e9b75f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:37:47.337+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:38:46.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=1423 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:38:46.639+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:38:46.691+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:38:47.029+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793927:29840][1423:0x7f4093c6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:38:47.029+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:38:47.040+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4092b9d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4092B7C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B733000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4093854000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4093650000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4093356000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4093141000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4092F24000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4092B7C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4093A5D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4092b9d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:38:47.040+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:39:46.166+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=1658 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:39:46.174+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:39:46.223+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:39:46.623+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507793986:623265][1658:0x7fe281985c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:39:46.623+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:39:46.642+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2808b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE280894000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF34ED6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE28156C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE281368000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE28106E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE280E59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE280C3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE280894000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE281775000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2808b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:39:46.642+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:40:46.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] MongoDB starting : pid=1864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:40:46.771+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:40:46.823+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:40:47.267+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794047:267961][1864:0x7f30d21fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:40:47.268+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:40:47.288+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30d112c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F30D110B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE62FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F30D1DE3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F30D1BDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F30D18E5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F30D16D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F30D14B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F30D110B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F30D1FEC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30d112c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:40:47.288+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:41:46.710+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] MongoDB starting : pid=1991 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:41:46.717+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:41:46.769+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:41:47.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794107:70076][1991:0x7fe9a8817c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:41:47.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:41:47.080+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe9a7747635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE9A7726000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88031000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE9A83FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE9A81FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE9A7F00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE9A7CEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE9A7ACE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE9A7726000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE9A8607000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe9a7747635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:41:47.080+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:42:46.206+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] MongoDB starting : pid=2243 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:42:46.213+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:42:46.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:42:46.706+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794166:705987][2243:0x7fb9f9c58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:42:46.706+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:42:46.725+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb9f8b88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB9F8B67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB9F983F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB9F963B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB9F9341000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB9F912C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9F8F0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB9F8B67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB9F9A48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb9f8b88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:42:46.725+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:43:46.983+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] MongoDB starting : pid=2496 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:43:46.990+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:43:47.040+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:43:47.458+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794227:458273][2496:0x7fd634cc8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:43:47.458+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:43:47.478+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd633bf8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD633BD7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7D4A8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD6348AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6346AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD6343B1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD63419C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD633F7F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD633BD7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD634AB8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd633bf8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:43:47.478+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:44:46.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=2739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:44:46.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:44:46.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:44:47.074+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794287:74475][2739:0x7ff6c1299c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:44:47.074+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:44:47.085+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff6c01c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF6C01A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF392FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF6C0E80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF6C0C7C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF6C0982000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF6C076D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF6C0550000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF6C01A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF6C1089000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff6c01c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:44:47.085+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:45:46.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=2947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:45:46.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:45:46.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:45:46.256+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:45:46.678+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794346:678042][2947:0x7f28556c8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:45:46.678+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:45:46.697+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28545f8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28545D7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39E38000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28552AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28550AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2854DB1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2854B9C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F285497F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28545D7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28554B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28545f8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:45:46.698+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:46:46.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=3081 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:46:46.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:46:46.155+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:46:46.580+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794406:580868][3081:0x7f1288b49c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:46:46.580+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:46:46.600+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1287a79635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1287A58000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88A90000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1288730000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F128852C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1288232000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F128801D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1287E00000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1287A58000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1288939000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1287a79635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:46:46.600+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:47:46.722+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] MongoDB starting : pid=3346 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:47:46.729+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:47:46.781+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:47:47.194+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794467:194861][3346:0x7f4441d8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:47:47.194+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:47:47.205+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4440cbd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4440C9C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF610C5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4441974000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4441770000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4441476000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4441261000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4441044000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4440C9C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4441B7D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4440cbd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:47:47.205+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:48:46.366+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:48:46.373+0000 I CONTROL [initandlisten] MongoDB starting : pid=3594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:48:46.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:48:46.424+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:48:46.736+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794526:736106][3594:0x7fb73c5c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:48:46.736+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:48:46.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb73b4f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB73B4D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB73C1A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB73BFA5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB73BCAB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB73BA96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB73B879000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB73B4D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB73C3B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb73b4f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:48:46.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:49:46.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=3844 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:49:46.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:49:46.939+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:49:47.325+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794587:325275][3844:0x7f770635fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:49:47.325+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:49:47.337+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f770528f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F770526E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF0EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7705F46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7705D42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7705A48000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7705833000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7705616000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F770526E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F770614F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f770528f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:49:47.337+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:50:46.466+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] MongoDB starting : pid=4052 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:50:46.474+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:50:46.526+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:50:46.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794646:841012][4052:0x7fe738f4ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:50:46.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:50:46.851+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe737e7e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE737E5D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF992FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE738B35000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE738931000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE738637000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE738422000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE738205000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE737E5D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE738D3E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe737e7e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:50:46.851+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:51:46.235+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] MongoDB starting : pid=4170 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:51:46.243+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:51:46.292+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:51:46.717+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794706:717407][4170:0x7f9a32e19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:51:46.717+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:51:46.738+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a31d49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A31D28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA72B6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A32A00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A327FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A32502000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A322ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A320D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A31D28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A32C09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a31d49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:51:46.738+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:52:46.862+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] MongoDB starting : pid=4425 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:52:46.869+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:52:46.919+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:52:47.336+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794767:336870][4425:0x7f33dd179c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:52:47.336+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:52:47.356+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33dc0a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33DC088000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33DCD60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33DCB5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33DC862000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33DC64D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33DC430000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33DC088000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33DCF69000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33dc0a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:52:47.356+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:53:46.527+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=4658 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:53:46.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:53:46.535+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:53:46.585+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:53:46.952+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794826:952371][4658:0x7f7254f55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:53:46.952+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:53:46.965+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7253e85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7253E64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF796FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7254B3C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7254938000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F725463E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7254429000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F725420C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7253E64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7254D45000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7253e85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:53:46.965+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:54:46.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] MongoDB starting : pid=4906 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:54:46.098+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:54:46.148+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:54:46.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794886:561062][4906:0x7fc17da31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:54:46.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:54:46.586+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc17c961635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC17C940000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DF5F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC17D618000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC17D414000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC17D11A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC17CF05000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC17CCE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC17C940000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC17D821000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc17c961635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:54:46.586+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:55:46.712+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] MongoDB starting : pid=5325 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:55:46.720+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:55:46.770+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:55:47.165+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507794947:165383][5325:0x7f8e6a89cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:55:47.165+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:55:47.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e697cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E697AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E6A483000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E6A27F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E69F85000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E69D70000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E69B53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E697AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E6A68C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e697cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:55:47.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:56:46.591+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=5514 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:56:46.598+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:56:46.599+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:56:46.649+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:56:47.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795007:50135][5514:0x7f1ce138cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:56:47.050+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:56:47.069+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1ce02bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CE029B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF063F1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CE0F73000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CE0D6F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CE0A75000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CE0860000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CE0643000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CE029B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CE117C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1ce02bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:56:47.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:57:46.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=5928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:57:46.210+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:57:46.259+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:57:46.579+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795066:579082][5928:0x7f75baf4fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:57:46.579+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:57:46.599+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f75b9e7f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F75B9E5E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0A2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F75BAB36000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F75BA932000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F75BA638000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F75BA423000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F75BA206000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F75B9E5E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F75BAD3F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f75b9e7f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:57:46.599+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:58:46.678+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] MongoDB starting : pid=6297 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:58:46.691+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:58:46.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:58:47.095+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795127:95830][6297:0x7f14156eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:58:47.095+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:58:47.107+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f141461e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14145FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F8A9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F14152D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F14150D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1414DD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1414BC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F14149A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14145FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F14154DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f141461e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:58:47.107+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T07:59:46.228+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] MongoDB starting : pid=6620 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] modules: none 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] build environment: 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T07:59:46.236+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T07:59:46.287+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T07:59:46.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795186:702833][6620:0x7f918efe0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T07:59:46.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T07:59:46.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f918df10635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F918DEEF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F918EBC7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F918E9C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F918E6C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F918E4B4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F918E297000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F918DEEF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F918EDD0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f918df10635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T07:59:46.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:00:46.851+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] MongoDB starting : pid=6841 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:00:46.858+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:00:46.908+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:00:47.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795247:305017][6841:0x7fa656d93c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:00:47.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:00:47.324+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa655cc3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA655CA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD3CEF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA65697A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA656776000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA65647C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA656267000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA65604A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA655CA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA656B83000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa655cc3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:00:47.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:01:46.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] MongoDB starting : pid=6976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:01:46.783+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:01:46.834+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:01:47.200+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795307:200364][6976:0x7f3c1b962c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:01:47.200+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:01:47.219+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c1a892635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C1A871000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C1B549000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C1B345000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C1B04B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C1AE36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C1AC19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C1A871000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C1B752000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c1a892635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:01:47.219+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:02:46.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=7097 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:02:46.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:02:46.680+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:02:47.119+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795367:119932][7097:0x7fd9236efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:02:47.120+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:02:47.139+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd92261f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD9225FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE048000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD9232D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD9230D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD922DD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD922BC3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD9229A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD9225FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD9234DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd92261f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:02:47.139+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:03:46.795+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] MongoDB starting : pid=7379 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:03:46.804+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:03:46.855+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:03:47.303+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795427:303765][7379:0x7f4926ef0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:03:47.303+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:03:47.323+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4925e20635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4925DFF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDE2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4926AD7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F49268D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F49265D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F49263C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F49261A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4925DFF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4926CE0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4925e20635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:03:47.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:04:46.456+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] MongoDB starting : pid=7617 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:04:46.464+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:04:46.516+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:04:46.864+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795486:864579][7617:0x7f1429944c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:04:46.864+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:04:46.885+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1428874635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1428853000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4AEA5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F142952B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1429327000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F142902D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1428E18000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1428BFB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1428853000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1429734000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1428874635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:04:46.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:05:47.023+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] MongoDB starting : pid=7828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:05:47.031+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:05:47.082+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:05:47.484+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795547:484589][7828:0x7fbfaa15fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:05:47.484+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:05:47.503+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbfa908f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBFA906E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F483000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBFA9D46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBFA9B42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBFA9848000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBFA9633000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBFA9416000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBFA906E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBFA9F4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbfa908f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:05:47.503+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:06:46.972+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] MongoDB starting : pid=8043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:06:46.980+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:06:47.030+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:06:47.309+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795607:309453][8043:0x7f540b2fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:06:47.309+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:06:47.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f540a22c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F540A20B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC558A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F540AEE3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F540ACDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F540A9E5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F540A7D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F540A5B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F540A20B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F540B0EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f540a22c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:06:47.322+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:07:46.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] MongoDB starting : pid=8163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:07:46.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:07:46.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:07:46.819+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795666:819565][8163:0x7f2d27e37c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:07:46.819+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:07:46.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d26d67635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D26D46000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D27A1E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D2781A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D27520000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D2730B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D270EE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D26D46000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D27C27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d26d67635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:07:46.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:08:46.903+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=8452 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:08:46.910+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:08:46.962+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:08:47.353+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795727:352990][8452:0x7feda1a59c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:08:47.353+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:08:47.373+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feda0989635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEDA0968000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBFD7B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEDA1640000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEDA143C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEDA1142000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEDA0F2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEDA0D10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEDA0968000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEDA1849000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feda0989635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:08:47.373+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:09:46.495+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] MongoDB starting : pid=8713 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:09:46.502+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:09:46.552+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:09:46.946+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795786:946230][8713:0x7f38f889fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:09:46.946+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:09:46.965+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f38f77cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38F77AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF78EA2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F38F8486000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38F8282000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F38F7F88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F38F7D73000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38F7B56000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38F77AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38F868F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f38f77cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:09:46.965+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:10:46.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] MongoDB starting : pid=8915 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:10:46.095+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:10:46.145+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:10:46.503+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795846:503183][8915:0x7fa576ac8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:10:46.503+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:10:46.516+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5759f8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5759D7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF640FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5766AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5764AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5761B1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA575F9C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA575D7F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5759D7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5768B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5759f8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:10:46.516+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:11:46.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] MongoDB starting : pid=9126 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:11:46.909+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:11:46.960+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:11:47.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795907:370931][9126:0x7f78b8f99c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:11:47.371+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:11:47.391+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78b7ec9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78B7EA8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF582CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78B8B80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78B897C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78B8682000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78B846D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78B8250000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78B7EA8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78B8D89000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78b7ec9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:11:47.391+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:12:46.514+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=9312 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:12:46.522+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:12:46.571+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:12:46.864+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507795966:864246][9312:0x7f04f7657c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:12:46.864+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:12:46.874+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04f6587635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04F6566000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF510FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04F723E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04F703A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04F6D40000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04F6B2B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04F690E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04F6566000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04F7447000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04f6587635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:12:46.874+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:13:47.004+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] MongoDB starting : pid=9652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:13:47.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:13:47.063+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:13:47.437+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796027:437161][9652:0x7fcf2f03ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:13:47.437+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:13:47.457+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf2df6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF2DF49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF133FF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF2EC21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF2EA1D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF2E723000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF2E50E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF2E2F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF2DF49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF2EE2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf2df6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:13:47.457+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:14:46.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] MongoDB starting : pid=9893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:14:46.594+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:14:46.645+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:14:46.996+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796086:996540][9893:0x7fc031c83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:14:46.996+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:14:47.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc030bb3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC030B92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC03186A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC031666000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC03136C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC031157000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC030F3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC030B92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC031A73000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc030bb3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:14:47.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:15:46.148+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] MongoDB starting : pid=10100 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:15:46.156+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:15:46.207+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:15:46.547+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796146:547066][10100:0x7f6f33efdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:15:46.547+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:15:46.557+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f32e2d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F32E0C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C8EC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F33AE4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F338E0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F335E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F333D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F331B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F32E0C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F33CED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f32e2d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:15:46.557+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:16:46.986+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:16:46.993+0000 I CONTROL [initandlisten] MongoDB starting : pid=10307 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:16:46.994+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:16:47.047+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:16:47.495+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796207:495302][10307:0x7f7a6bfaec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:16:47.495+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:16:47.514+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a6aede635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A6AEBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A6BB95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A6B991000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A6B697000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A6B482000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A6B265000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A6AEBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A6BD9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a6aede635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:16:47.514+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:17:46.638+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] MongoDB starting : pid=10426 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:17:46.646+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:17:46.696+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:17:47.038+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796267:38369][10426:0x7f53fa46bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:17:47.038+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:17:47.048+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53f939b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53F937A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD32FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53FA052000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53F9E4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53F9B54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F53F993F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F53F9722000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53F937A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53FA25B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53f939b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:17:47.048+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:18:46.390+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] MongoDB starting : pid=10705 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:18:46.397+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:18:46.447+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:18:46.817+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796326:817001][10705:0x7f969da06c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:18:46.817+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:18:46.836+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f969c936635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F969C915000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFB271000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F969D5ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F969D3E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F969D0EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F969CEDA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F969CCBD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F969C915000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F969D7F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f969c936635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:18:46.836+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:19:46.958+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] MongoDB starting : pid=10946 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:19:46.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:19:47.015+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:19:47.349+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796387:349045][10946:0x7f7eff1bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:19:47.349+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:19:47.359+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7efe0ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EFE0CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF336FA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EFEDA5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EFEBA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EFE8A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EFE692000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EFE475000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EFE0CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EFEFAE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7efe0ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:19:47.359+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:20:46.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:20:46.497+0000 I CONTROL [initandlisten] MongoDB starting : pid=11144 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:20:46.497+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:20:46.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:20:46.548+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:20:46.848+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796446:848158][11144:0x7fba3dea1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:20:46.848+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:20:46.861+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba3cdd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA3CDB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA3DA88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA3D884000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA3D58A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA3D375000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA3D158000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA3CDB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA3DC91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba3cdd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:20:46.861+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:21:46.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] MongoDB starting : pid=11350 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:21:46.290+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:21:46.340+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:21:46.762+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796506:762220][11350:0x7f36a84c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:21:46.762+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:21:46.782+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36a73f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36A73D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72028000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36A80AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36A7EA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36A7BAF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36A799A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36A777D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36A73D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36A82B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36a73f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:21:46.782+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:22:46.911+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] MongoDB starting : pid=11467 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:22:46.918+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:22:46.968+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:22:47.348+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796567:348457][11467:0x7f2fe6ce3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:22:47.348+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:22:47.362+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2fe5c13635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FE5BF2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FE68CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FE66C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FE63CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FE61B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FE5F9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FE5BF2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FE6AD3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2fe5c13635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:22:47.363+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:23:46.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] MongoDB starting : pid=11755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:23:46.581+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:23:46.631+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:23:47.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796627:3387][11755:0x7f86533eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:23:47.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:23:47.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f865231e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86522FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8652FD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8652DD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8652AD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86528C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86526A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86522FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86531DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f865231e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:23:47.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:24:46.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=12000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:24:46.158+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:24:46.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:24:46.609+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796686:609406][12000:0x7f5010e42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:24:46.609+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:24:46.629+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f500fd72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F500FD51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5010A29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5010825000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F501052B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5010316000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F50100F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F500FD51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5010C32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f500fd72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:24:46.629+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:25:46.746+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] MongoDB starting : pid=12210 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:25:46.754+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:25:46.804+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:25:47.157+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796747:157266][12210:0x7fbceec18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:25:47.157+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:25:47.168+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbcedb48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBCEDB27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBCEE7FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBCEE5FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBCEE301000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBCEE0EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBCEDECF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBCEDB27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBCEEA08000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbcedb48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:25:47.168+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:26:46.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] MongoDB starting : pid=12428 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:26:46.542+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:26:46.593+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:26:47.058+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796807:58018][12428:0x7f5d3d940c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:26:47.058+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:26:47.083+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d3c870635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D3C84F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFECCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D3D527000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D3D323000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D3D029000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D3CE14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D3CBF7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D3C84F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D3D730000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d3c870635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:26:47.083+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:27:46.207+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] MongoDB starting : pid=12548 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:27:46.215+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:27:46.264+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:27:46.673+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796866:673897][12548:0x7fe0b6639c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:27:46.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:27:46.693+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0b5569635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0B5548000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF690FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0B6220000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0B601C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE0B5D22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE0B5B0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE0B58F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0B5548000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0B6429000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0b5569635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:27:46.693+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:28:46.754+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] MongoDB starting : pid=12850 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:28:46.761+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:28:46.812+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:28:47.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796927:242203][12850:0x7f19bc75dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:28:47.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:28:47.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19bb68d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19BB66C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF574FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19BC344000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19BC140000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19BBE46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19BBC31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19BBA14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19BB66C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19BC54D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19bb68d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:28:47.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:29:46.387+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] MongoDB starting : pid=13090 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:29:46.394+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:29:46.447+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:29:46.881+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507796986:881680][13090:0x7f1408b32c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:29:46.881+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:29:46.901+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1407a62635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1407A41000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF714FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1408719000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1408515000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F140821B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1408006000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1407DE9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1407A41000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1408922000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1407a62635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:29:46.901+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:30:47.036+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] MongoDB starting : pid=13294 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:30:47.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:30:47.105+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:30:47.495+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797047:495310][13294:0x7fa084d5cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:30:47.495+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:30:47.515+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa083c8c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA083C6B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA12FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA084943000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA08473F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA084445000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA084230000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA084013000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA083C6B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA084B4C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa083c8c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:30:47.515+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:31:46.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=13498 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:31:46.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:31:46.972+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:31:47.342+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797107:342523][13498:0x7fb54c909c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:31:47.342+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:31:47.361+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb54b839635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB54B818000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB54C4F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB54C2EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB54BFF2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB54BDDD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB54BBC0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB54B818000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB54C6F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb54b839635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:31:47.362+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:32:46.489+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] MongoDB starting : pid=13616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:32:46.496+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:32:46.546+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:32:46.885+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797166:885427][13616:0x7f5b7fff0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:32:46.885+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:32:46.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5b7ef20635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5B7EEFF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31C1F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5B7FBD7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5B7F9D3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5B7F6D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5B7F4C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5B7F2A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5B7EEFF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5B7FDE0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5b7ef20635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:32:46.904+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:33:46.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] MongoDB starting : pid=13895 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:33:46.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:33:46.946+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:33:47.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797227:370607][13895:0x7fcfdacbfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:33:47.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:33:47.390+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcfd9bef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCFD9BCE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF414FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFDA8A6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFDA6A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFDA3A8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFDA193000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFD9F76000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCFD9BCE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFDAAAF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcfd9bef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:33:47.390+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:34:46.514+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=14132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:34:46.522+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:34:46.572+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:34:46.981+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797286:981335][14132:0x7f68bc77fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:34:46.981+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:34:47.000+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68bb6af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68BB68E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1D52000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68BC366000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68BC162000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68BBE68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68BBC53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68BBA36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68BB68E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68BC56F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68bb6af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:34:47.000+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:35:46.131+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] MongoDB starting : pid=14320 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:35:46.139+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:35:46.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:35:46.573+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797346:573211][14320:0x7fbb8c326c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:35:46.573+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:35:46.591+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb8b256635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB8B235000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB8BF0D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB8BD09000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB8BA0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB8B7FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB8B5DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB8B235000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB8C116000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb8b256635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:35:46.591+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:36:46.984+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] MongoDB starting : pid=14756 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:36:46.993+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:36:46.994+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:36:47.043+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:36:47.424+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797407:424484][14756:0x7f00a2e78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:36:47.424+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:36:47.436+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00a1da8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00A1D87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00A2A5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00A285B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00A2561000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00A234C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00A212F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00A1D87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00A2C68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00a1da8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:36:47.436+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:37:46.555+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] MongoDB starting : pid=15000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:37:46.562+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:37:46.612+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:37:47.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797467:52269][15000:0x7f9d0d09cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:37:47.052+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:37:47.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d0bfcc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D0BFAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBFEF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D0CC83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D0CA7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D0C785000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D0C570000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D0C353000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D0BFAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D0CE8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d0bfcc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:37:47.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:38:46.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] MongoDB starting : pid=15151 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:38:46.978+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:38:47.028+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:38:47.275+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797527:275935][15151:0x7f83457c8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:38:47.275+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:38:47.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83446f8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83446D7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04DC0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83453AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83451AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8344EB1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8344C9C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8344A7F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83446D7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83455B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83446f8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:38:47.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:39:46.408+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] MongoDB starting : pid=15457 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:39:46.416+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:39:46.467+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:39:46.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797586:896205][15457:0x7fcbc7d74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:39:46.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:39:46.915+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbc6ca4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBC6C83000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD40CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBC795B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBC7757000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBC745D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBC7248000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBC702B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBC6C83000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBC7B64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbc6ca4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:39:46.915+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:40:47.037+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] MongoDB starting : pid=15660 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:40:47.045+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:40:47.095+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:40:47.532+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797647:532352][15660:0x7fd4c4d76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:40:47.532+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:40:47.551+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4c3ca6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4C3C85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF05CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD4C495D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD4C4759000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD4C445F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD4C424A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD4C402D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4C3C85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4C4B66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4c3ca6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:40:47.551+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:41:46.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=15868 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:41:46.998+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:41:47.047+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:41:47.488+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797707:488020][15868:0x7fe057c69c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:41:47.488+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:41:47.507+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe056b99635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE056B78000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE057850000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE05764C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE057352000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE05713D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE056F20000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE056B78000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE057A59000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe056b99635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:41:47.507+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:42:46.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] MongoDB starting : pid=16071 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:42:46.641+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:42:46.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:42:46.992+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797766:992187][16071:0x7fd8cbdd4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:42:46.992+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:42:47.003+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8cad04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8CACE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD8CB9BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD8CB7B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD8CB4BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD8CB2A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD8CB08B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8CACE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8CBBC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8cad04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:42:47.003+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:43:46.067+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] MongoDB starting : pid=16228 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:43:46.075+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:43:46.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:43:46.550+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797826:550235][16228:0x7f9f340a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:43:46.550+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:43:46.569+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9f32fd7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9F32FB6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF87527000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9F33C8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9F33A8A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9F33790000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9F3357B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9F3335E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9F32FB6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9F33E97000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9f32fd7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:43:46.569+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:44:46.707+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] MongoDB starting : pid=16519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:44:46.715+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:44:46.765+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:44:47.163+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797887:163785][16519:0x7fe581c57c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:44:47.163+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:44:47.174+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe580b87635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE580B66000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6064000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE58183E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE58163A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE581340000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE58112B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE580F0E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE580B66000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE581A47000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe580b87635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:44:47.174+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:45:46.306+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] MongoDB starting : pid=16722 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:45:46.313+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:45:46.364+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:45:46.777+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507797946:777339][16722:0x7f649c211c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:45:46.777+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:45:46.796+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f649b141635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F649B120000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA512000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F649BDF8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F649BBF4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F649B8FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F649B6E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F649B4C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F649B120000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F649C001000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f649b141635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:45:46.796+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:46:46.181+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] MongoDB starting : pid=16927 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:46:46.189+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:46:46.238+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:46:46.675+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798006:675464][16927:0x7f0c47fe2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:46:46.675+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:46:46.695+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c46f12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C46EF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF694FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C47BC9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C479C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C476CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C474B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C47299000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C46EF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C47DD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c46f12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:46:46.695+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:47:46.814+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] MongoDB starting : pid=17129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:47:46.821+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:47:46.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:47:47.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798067:296662][17129:0x7facc2eacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:47:47.296+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:47:47.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7facc1ddc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FACC1DBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF6F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FACC2A93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FACC288F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FACC2595000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FACC2380000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FACC2163000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FACC1DBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FACC2C9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7facc1ddc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:47:47.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:48:46.252+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] MongoDB starting : pid=17277 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:48:46.261+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:48:46.312+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:48:46.717+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798126:717814][17277:0x7fc58b09dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:48:46.717+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:48:46.728+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc589fcd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC589FAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC58AC84000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC58AA80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC58A786000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC58A571000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC58A354000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC589FAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC58AE8D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc589fcd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:48:46.729+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:49:46.855+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] MongoDB starting : pid=17571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:49:46.863+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:49:46.913+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:49:47.334+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798187:334779][17571:0x7f81b26e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:49:47.334+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:49:47.354+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f81b1611635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F81B15F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CA35000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F81B22C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F81B20C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F81B1DCA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81B1BB5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F81B1998000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F81B15F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F81B24D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f81b1611635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:49:47.354+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:50:46.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=17773 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:50:46.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:50:46.537+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:50:46.926+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798246:926076][17773:0x7fc8d6d18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:50:46.926+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:50:46.945+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8d5c48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8D5C27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B38D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8D68FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8D66FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8D6401000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8D61EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8D5FCF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8D5C27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8D6B08000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8d5c48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:50:46.945+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:51:46.315+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:51:46.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=17988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:51:46.323+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:51:46.372+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:51:46.790+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798306:790434][17988:0x7f57a3563c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:51:46.790+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:51:46.810+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f57a2493635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F57A2472000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F57A314A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F57A2F46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F57A2C4C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F57A2A37000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F57A281A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F57A2472000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F57A3353000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f57a2493635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:51:46.810+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:52:46.942+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] MongoDB starting : pid=18188 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:52:46.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:52:46.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:52:47.383+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798367:383644][18188:0x7f1525773c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:52:47.383+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:52:47.403+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15246a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1524682000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB40BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F152535A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1525156000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1524E5C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1524C47000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1524A2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1524682000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1525563000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15246a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:52:47.403+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:53:46.755+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] MongoDB starting : pid=18335 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:53:46.762+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:53:46.813+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:53:47.165+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798427:165474][18335:0x7f1e73cc8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:53:47.165+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:53:47.176+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e72bf8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E72BD7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2EE6E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E738AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E736AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E733B1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E7319C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E72F7F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E72BD7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E73AB8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e72bf8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:53:47.176+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:54:46.293+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:54:46.300+0000 I CONTROL [initandlisten] MongoDB starting : pid=18629 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:54:46.300+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:54:46.300+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:54:46.301+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:54:46.301+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:54:46.301+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:54:46.301+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:54:46.301+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:54:46.301+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:54:46.351+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:54:46.738+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798486:738421][18629:0x7f12c96eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:54:46.738+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:54:46.758+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12c861a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12C85F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0658A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12C92D1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12C90CD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12C8DD3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F12C8BBE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F12C89A1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12C85F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12C94DA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12c861a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:54:46.758+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:55:46.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] MongoDB starting : pid=18841 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:55:46.904+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:55:46.955+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:55:47.320+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798547:320194][18841:0x7fdd5ecdbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:55:47.320+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:55:47.340+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd5dc0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD5DBEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7ABE9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD5E8C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD5E6BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD5E3C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD5E1AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD5DF92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD5DBEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD5EACB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd5dc0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:55:47.340+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:56:46.779+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=19051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:56:46.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:56:46.836+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:56:47.163+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798607:163236][19051:0x7f4a0e197c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:56:47.163+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:56:47.174+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a0d0c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A0D0A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A0DD7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A0DB7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A0D880000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A0D66B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A0D44E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A0D0A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A0DF87000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a0d0c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:56:47.174+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:57:46.308+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] MongoDB starting : pid=19250 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:57:46.316+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:57:46.366+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:57:46.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798666:741248][19250:0x7f9e9c6a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:57:46.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:57:46.754+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e9b5d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E9B5AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E9C287000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E9C083000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E9BD89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E9BB74000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E9B957000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E9B5AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E9C490000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e9b5d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:57:46.754+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:58:47.030+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=19406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:58:47.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:58:47.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:58:47.468+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798727:468811][19406:0x7f785d3e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:58:47.468+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:58:47.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f785c318635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F785C2F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC612000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F785CFCF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F785CDCB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F785CAD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F785C8BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F785C69F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F785C2F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F785D1D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f785c318635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:58:47.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T08:59:46.604+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] MongoDB starting : pid=19696 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] modules: none 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] build environment: 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T08:59:46.612+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T08:59:46.675+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T08:59:47.055+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798787:55601][19696:0x7f9bc5f2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T08:59:47.055+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T08:59:47.074+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9bc4e5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9BC4E3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9BC5B13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9BC590F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9BC5615000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9BC5400000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9BC51E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9BC4E3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9BC5D1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9bc4e5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T08:59:47.074+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:00:46.200+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=19908 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:00:46.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:00:46.258+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:00:46.624+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798846:624385][19908:0x7fc9e3b23c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:00:46.624+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:00:46.643+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9e2a53635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9E2A32000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1F7DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9E370A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9E3506000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9E320C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9E2FF7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9E2DDA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9E2A32000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9E3913000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9e2a53635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:00:46.643+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:01:46.110+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] MongoDB starting : pid=20119 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:01:46.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:01:46.171+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:01:46.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798906:463348][20119:0x7f49fed37c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:01:46.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:01:46.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f49fdc67635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F49FDC46000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF672FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F49FE91E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F49FE71A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F49FE420000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F49FE20B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F49FDFEE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F49FDC46000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F49FEB27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f49fdc67635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:01:46.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:02:46.845+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] MongoDB starting : pid=20329 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:02:46.853+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:02:46.904+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:02:47.316+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507798967:316431][20329:0x7f0e86ee4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:02:47.316+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:02:47.335+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e85e14635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E85DF3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF674FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E86ACB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E868C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E865CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E863B8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E8619B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E85DF3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E86CD4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e85e14635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:02:47.335+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:03:47.021+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] MongoDB starting : pid=20475 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:03:47.029+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:03:47.084+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:03:47.392+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799027:392308][20475:0x7f3e7cd43c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:03:47.392+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:03:47.403+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e7bc73635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E7BC52000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26CF1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E7C92A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E7C726000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E7C42C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E7C217000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E7BFFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E7BC52000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E7CB33000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e7bc73635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:03:47.403+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:04:46.537+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:04:46.545+0000 I CONTROL [initandlisten] MongoDB starting : pid=20767 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:04:46.546+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:04:46.604+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:04:46.971+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799086:971086][20767:0x7fefda59bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:04:46.971+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:04:46.990+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fefd94cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFD94AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79692000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFDA182000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFD9F7E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFD9C84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFD9A6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFD9852000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFD94AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFDA38B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fefd94cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:04:46.990+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:05:46.102+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] MongoDB starting : pid=21002 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:05:46.110+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:05:46.159+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:05:46.537+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799146:537788][21002:0x7f45f68e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:05:46.537+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:05:46.556+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45f5817635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45F57F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45F64CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45F62CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45F5FD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F45F5DBB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F45F5B9E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45F57F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45F66D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45f5817635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:05:46.556+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:06:46.984+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:06:46.991+0000 I CONTROL [initandlisten] MongoDB starting : pid=21209 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:06:46.992+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:06:47.042+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:06:47.329+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799207:329196][21209:0x7f5d72884c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:06:47.329+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:06:47.339+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d717b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D71793000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF556FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D7246B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D72267000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D71F6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D71D58000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D71B3B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D71793000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D72674000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d717b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:06:47.339+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:07:46.481+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] MongoDB starting : pid=21408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:07:46.488+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:07:46.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:07:46.934+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799266:934623][21408:0x7f8d4cbe1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:07:46.934+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:07:46.954+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d4bb11635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D4BAF0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA88D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D4C7C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D4C5C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D4C2CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D4C0B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D4BE98000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D4BAF0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D4C9D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d4bb11635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:07:46.954+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:08:46.076+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] MongoDB starting : pid=21554 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:08:46.083+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:08:46.133+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:08:46.426+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799326:426551][21554:0x7fd351defc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:08:46.426+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:08:46.437+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd350d1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD350CFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF758FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3519D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3517D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3514D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3512C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD3510A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD350CFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD351BDF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd350d1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:08:46.437+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:09:46.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] MongoDB starting : pid=21831 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:09:46.471+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:09:46.522+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:09:46.901+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799386:901480][21831:0x7f1ca4dfec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:09:46.901+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:09:46.918+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1ca3d2e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CA3D0D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF257E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CA49E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CA47E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CA44E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CA42D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CA40B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CA3D0D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CA4BEE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1ca3d2e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:09:46.918+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:10:47.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] MongoDB starting : pid=22058 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:10:47.036+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:10:47.085+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:10:47.437+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799447:437614][22058:0x7f7831abfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:10:47.437+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:10:47.457+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78309ef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78309CE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF406FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78316A6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78314A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78311A8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7830F93000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7830D76000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78309CE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78318AF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78309ef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:10:47.457+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:11:46.838+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] MongoDB starting : pid=22261 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:11:46.845+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:11:46.895+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:11:47.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799507:291843][22261:0x7f6f95557c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:11:47.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:11:47.311+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f94487635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F94466000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0026000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F9513E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F94F3A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F94C40000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F94A2B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F9480E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F94466000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F95347000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f94487635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:11:47.311+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:12:46.432+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:12:46.440+0000 I CONTROL [initandlisten] MongoDB starting : pid=22381 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:12:46.440+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:12:46.440+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:12:46.440+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:12:46.441+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:12:46.441+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:12:46.441+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:12:46.441+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:12:46.441+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:12:46.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:12:46.772+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799566:772080][22381:0x7fc8a50d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:12:46.772+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:12:46.783+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8a4008635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8A3FE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72332000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8A4CBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8A4ABB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8A47C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8A45AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8A438F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8A3FE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8A4EC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8a4008635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:12:46.783+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:13:46.919+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:13:46.926+0000 I CONTROL [initandlisten] MongoDB starting : pid=22617 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:13:46.926+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:13:46.926+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:13:46.926+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:13:46.926+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:13:46.927+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:13:46.927+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:13:46.927+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:13:46.927+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:13:46.976+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:13:47.382+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799627:382596][22617:0x7ff241b3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:13:47.382+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:13:47.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff240a6b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF240A4A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEF7D5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF241722000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF24151E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF241224000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF24100F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF240DF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF240A4A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF24192B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff240a6b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:13:47.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:14:46.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] MongoDB starting : pid=22749 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:14:46.873+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:14:46.924+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:14:47.236+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799687:236769][22749:0x7fc4090d5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:14:47.236+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:14:47.248+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc408005635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC407FE4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15E5D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC408CBC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC408AB8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4087BE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4085A9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC40838C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC407FE4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC408EC5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc408005635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:14:47.248+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:15:46.347+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] MongoDB starting : pid=23023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:15:46.353+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:15:46.384+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:15:46.754+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799746:754529][23023:0x7fa753a37c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:15:46.754+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:15:46.774+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa752967635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA752946000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA75361E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA75341A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA753120000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA752F0B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA752CEE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA752946000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA753827000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa752967635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:15:46.774+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:16:46.169+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] MongoDB starting : pid=23226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:16:46.176+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:16:46.225+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:16:46.558+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799806:558171][23226:0x7f762eb22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:16:46.558+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:16:46.573+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f762da52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F762DA31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84994000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F762E709000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F762E505000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F762E20B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F762DFF6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F762DDD9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F762DA31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F762E912000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f762da52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:16:46.573+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:17:46.707+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:17:46.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=23436 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:17:46.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:17:46.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:17:46.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:17:46.714+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:17:46.715+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:17:46.715+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:17:46.715+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:17:46.715+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:17:46.764+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:17:47.165+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799867:165028][23436:0x7fb0cb208c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:17:47.165+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:17:47.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0ca138635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0CA117000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF184FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0CADEF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0CABEB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0CA8F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0CA6DC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0CA4BF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0CA117000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0CAFF8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0ca138635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:17:47.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:18:46.319+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] MongoDB starting : pid=23671 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:18:46.326+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:18:46.376+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:18:46.737+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799926:737706][23671:0x7f44c26edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:18:46.737+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:18:46.749+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44c161d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44C15FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3AB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44C22D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44C20D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44C1DD6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44C1BC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44C19A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44C15FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44C24DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44c161d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:18:46.749+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:19:46.905+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] MongoDB starting : pid=23795 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:19:46.912+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:19:46.961+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:19:47.339+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507799987:339483][23795:0x7f565dc31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:19:47.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:19:47.358+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f565cb61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F565CB40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF608FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F565D818000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F565D614000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F565D31A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F565D105000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F565CEE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F565CB40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F565DA21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f565cb61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:19:47.359+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:20:46.489+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] MongoDB starting : pid=24080 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:20:46.497+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:20:46.559+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:20:46.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800046:915359][24080:0x7f6aad88ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:20:46.915+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:20:46.934+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6aac7be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6AAC79D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6AAD475000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6AAD271000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6AACF77000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6AACD62000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6AACB45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6AAC79D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6AAD67E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6aac7be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:20:46.934+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:21:46.294+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] MongoDB starting : pid=24284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:21:46.301+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:21:46.351+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:21:46.669+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800106:669021][24284:0x7f68d760dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:21:46.669+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:21:46.688+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68d653d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68D651C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39052000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68D71F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68D6FF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68D6CF6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68D6AE1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68D68C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68D651C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68D73FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68d653d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:21:46.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:22:46.805+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] MongoDB starting : pid=24486 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:22:46.813+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:22:46.862+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:22:47.198+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800167:198967][24486:0x7fdc6d868c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:22:47.199+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:22:47.219+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc6c798635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC6C777000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCC01000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC6D44F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC6D24B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC6CF51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC6CD3C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC6CB1F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC6C777000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC6D658000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc6c798635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:22:47.219+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:23:46.333+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:23:46.340+0000 I CONTROL [initandlisten] MongoDB starting : pid=24714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:23:46.341+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:23:46.390+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:23:46.729+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800226:729852][24714:0x7fdd6638cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:23:46.729+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:23:46.749+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd652bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD6529B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD65F73000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD65D6F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD65A75000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD65860000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD65643000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD6529B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD6617C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd652bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:23:46.749+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:24:46.355+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] MongoDB starting : pid=24833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:24:46.364+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:24:46.415+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:24:46.788+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800286:788258][24833:0x7f24ac8fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:24:46.788+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:24:46.807+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24ab82b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24AB80A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F24AC4E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F24AC2DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F24ABFE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F24ABDCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F24ABBB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24AB80A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24AC6EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24ab82b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:24:46.807+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:25:46.935+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] MongoDB starting : pid=25125 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:25:46.942+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:25:46.992+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:25:47.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800347:338110][25125:0x7f83e6578c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:25:47.338+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:25:47.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83e54a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83E5487000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE24FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83E615F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83E5F5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83E5C61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83E5A4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83E582F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83E5487000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83E6368000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83e54a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:25:47.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:26:46.754+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] MongoDB starting : pid=25332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:26:46.762+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:26:46.812+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:26:47.177+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800407:177055][25332:0x7f026f304c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:26:47.177+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:26:47.196+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f026e234635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F026E213000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F026EEEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F026ECE7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F026E9ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F026E7D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F026E5BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F026E213000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F026F0F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f026e234635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:26:47.196+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:27:46.318+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] MongoDB starting : pid=25533 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:27:46.326+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:27:46.375+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:27:46.752+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800466:752399][25533:0x7fdf6000cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:27:46.752+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:27:46.762+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf5ef3c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF5EF1B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF5FBF3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF5F9EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF5F6F5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF5F4E0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF5F2C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF5EF1B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF5FDFC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf5ef3c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:27:46.762+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:28:46.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=25773 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:28:46.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:28:46.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:28:47.322+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800527:322566][25773:0x7fc308d71c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:28:47.322+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:28:47.338+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc307ca1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC307C80000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA02FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC308958000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC308754000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC30845A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC308245000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC308028000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC307C80000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC308B61000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc307ca1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:28:47.338+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:29:46.819+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=25890 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:29:46.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:29:46.877+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:29:47.288+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800587:288638][25890:0x7fa99d2d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:29:47.288+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:29:47.308+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa99c201635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA99C1E0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF670FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA99CEB8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA99CCB4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA99C9BA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA99C7A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA99C588000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA99C1E0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA99D0C1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa99c201635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:29:47.308+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:30:46.428+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] MongoDB starting : pid=26192 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:30:46.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:30:46.487+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:30:46.773+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800646:773384][26192:0x7f0a2950fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:30:46.773+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:30:46.784+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a2843f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A2841E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA2F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A290F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A28EF2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A28BF8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A289E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A287C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A2841E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A292FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a2843f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:30:46.784+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:31:46.202+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] MongoDB starting : pid=26399 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:31:46.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:31:46.262+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:31:46.627+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800706:627787][26399:0x7fe61a5dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:31:46.627+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:31:46.647+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe61950e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE6194ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD44FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE61A1C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE619FC1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE619CC7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE619AB2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE619895000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE6194ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE61A3CE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe61950e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:31:46.647+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:32:46.774+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] MongoDB starting : pid=26600 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:32:46.781+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:32:46.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:32:46.831+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:32:47.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800767:242301][26600:0x7f36a7961c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:32:47.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:32:47.252+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36a6891635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36A6870000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF034D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36A7548000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36A7344000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36A704A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36A6E35000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36A6C18000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36A6870000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36A7751000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36a6891635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:32:47.252+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:33:46.364+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] MongoDB starting : pid=26822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:33:46.368+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:33:46.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:33:46.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800826:696651][26822:0x7fc7f3477c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:33:46.696+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:33:46.713+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7f23a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7F2386000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF478FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7F305E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7F2E5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7F2B60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7F294B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7F272E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7F2386000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7F3267000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7f23a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:33:46.713+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:34:46.265+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] MongoDB starting : pid=26945 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:34:46.273+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:34:46.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:34:46.743+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800886:743818][26945:0x7fc48e7e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:34:46.743+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:34:46.763+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc48d718635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC48D6F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF342FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC48E3CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC48E1CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC48DED1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC48DCBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC48DA9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC48D6F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC48E5D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc48d718635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:34:46.763+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:35:46.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=27247 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:35:46.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:35:46.948+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:35:47.373+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507800947:373573][27247:0x7fac36acbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:35:47.373+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:35:47.393+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac359fb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC359DA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF04FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC366B2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC364AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC361B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC35F9F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC35D82000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC359DA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC368BB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac359fb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:35:47.393+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:36:46.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] MongoDB starting : pid=27453 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:36:46.772+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:36:46.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:36:47.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801007:261395][27453:0x7f474983cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:36:47.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:36:47.280+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f474876c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F474874B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4749423000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F474921F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4748F25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4748D10000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4748AF3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F474874B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F474962C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f474876c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:36:47.280+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:37:46.395+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] MongoDB starting : pid=27651 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:37:46.403+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:37:46.454+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:37:46.875+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801066:875753][27651:0x7f88d6d85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:37:46.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:37:46.895+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88d5cb5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88D5C94000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2606F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F88D696C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88D6768000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88D646E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88D6259000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88D603C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88D5C94000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F88D6B75000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88d5cb5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:37:46.895+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:38:47.023+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] MongoDB starting : pid=27870 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:38:47.031+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:38:47.081+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:38:47.418+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801127:418116][27870:0x7f77bf835c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:38:47.418+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:38:47.438+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f77be765635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F77BE744000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7419000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F77BF41C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F77BF218000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F77BEF1E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F77BED09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F77BEAEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F77BE744000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F77BF625000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f77be765635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:38:47.438+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:39:46.391+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] MongoDB starting : pid=28006 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:39:46.398+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:39:46.449+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:39:46.872+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801186:872135][28006:0x7f0ea7a21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:39:46.872+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:39:46.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ea6951635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EA6930000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA1E8A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EA7608000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EA7404000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EA710A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EA6EF5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EA6CD8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EA6930000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EA7811000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ea6951635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:39:46.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:40:47.009+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] MongoDB starting : pid=28299 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:40:47.019+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:40:47.069+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:40:47.481+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801247:481118][28299:0x7fd154baac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:40:47.481+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:40:47.500+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd153ada635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD153AB9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF470FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD154791000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD15458D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD154293000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD15407E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD153E61000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD153AB9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD15499A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd153ada635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:40:47.500+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:41:46.903+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=28510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:41:46.910+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:41:46.960+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:41:47.378+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801307:378192][28510:0x7f26810e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:41:47.378+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:41:47.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2680017635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F267FFF6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB849A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2680CCE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2680ACA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F26807D0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F26805BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F268039E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F267FFF6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2680ED7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2680017635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:41:47.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:42:46.506+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] MongoDB starting : pid=28722 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:42:46.514+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:42:46.565+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:42:46.981+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801366:981243][28722:0x7f41a1abfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:42:46.981+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:42:47.001+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41a09ef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41A09CE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F41A16A6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F41A14A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41A11A8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F41A0F93000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F41A0D76000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41A09CE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41A18AF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41a09ef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:42:47.001+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:43:46.122+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] MongoDB starting : pid=28942 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:43:46.129+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:43:46.179+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:43:46.550+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801426:550923][28942:0x7fd22dbc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:43:46.550+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:43:46.561+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd22caf9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD22CAD8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF786FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD22D7B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD22D5AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD22D2B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD22D09D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD22CE80000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD22CAD8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD22D9B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd22caf9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:43:46.561+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:44:46.506+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] MongoDB starting : pid=29080 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:44:46.514+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:44:46.563+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:44:46.970+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801486:970354][29080:0x7fe984339c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:44:46.970+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:44:46.990+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe983269635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE983248000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F2FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE983F20000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE983D1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE983A22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE98380D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE9835F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE983248000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE984129000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe983269635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:44:46.990+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:45:46.116+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] MongoDB starting : pid=29367 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:45:46.124+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:45:46.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:45:46.601+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801546:601580][29367:0x7faeb17a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:45:46.601+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:45:46.626+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faeb06d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAEB06B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC6A4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAEB138A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAEB1186000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAEB0E8C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAEB0C77000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAEB0A5A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAEB06B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAEB1593000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faeb06d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:45:46.626+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:46:46.050+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] MongoDB starting : pid=29572 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:46:46.058+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:46:46.111+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:46:46.529+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801606:529689][29572:0x7f540997fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:46:46.529+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:46:46.549+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54088af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F540888E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA1D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5409566000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5409362000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5409068000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5408E53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5408C36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F540888E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F540976F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54088af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:46:46.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:47:46.686+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:47:46.693+0000 I CONTROL [initandlisten] MongoDB starting : pid=29756 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:47:46.693+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:47:46.693+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:47:46.693+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:47:46.694+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:47:46.694+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:47:46.694+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:47:46.694+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:47:46.694+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:47:46.756+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:47:47.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801667:129205][29756:0x7f4435ccdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:47:47.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:47:47.141+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4434bfd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4434BDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2214000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44358B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44356B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44353B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44351A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4434F84000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4434BDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4435ABD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4434bfd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:47:47.141+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:48:46.270+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] MongoDB starting : pid=29885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:48:46.277+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:48:46.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:48:46.659+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801726:659595][29885:0x7f07d0f0cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:48:46.659+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:48:46.678+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f07cfe3c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F07CFE1B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF228FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F07D0AF3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F07D08EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F07D05F5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F07D03E0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F07D01C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F07CFE1B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F07D0CFC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f07cfe3c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:48:46.678+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:49:46.703+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] MongoDB starting : pid=30103 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:49:46.711+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:49:46.761+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:49:47.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801787:132726][30103:0x7f58c473cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:49:47.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:49:47.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58c366c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58C364B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF312E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58C4323000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58C411F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58C3E25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58C3C10000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58C39F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58C364B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58C452C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58c366c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:49:47.152+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:50:46.275+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] MongoDB starting : pid=30258 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:50:46.283+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:50:46.334+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:50:46.761+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801846:761443][30258:0x7f7da1b57c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:50:46.761+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:50:46.781+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7da0a87635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DA0A66000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DA173E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DA153A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DA1240000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DA102B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DA0E0E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DA0A66000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DA1947000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7da0a87635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:50:46.781+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:51:46.236+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] MongoDB starting : pid=30511 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:51:46.243+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:51:46.294+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:51:46.609+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801906:609524][30511:0x7f7c4dbb3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:51:46.609+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:51:46.623+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c4cae3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C4CAC2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE28FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C4D79A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C4D596000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C4D29C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C4D087000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C4CE6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C4CAC2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C4D9A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c4cae3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:51:46.623+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:52:46.749+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] MongoDB starting : pid=30712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:52:46.756+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:52:46.807+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:52:47.190+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507801967:190504][30712:0x7fa8724ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:52:47.190+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:52:47.209+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8713fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8713DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF59CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8720B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA871EAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA871BB5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8719A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA871783000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8713DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8722BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8713fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:52:47.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:53:46.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] MongoDB starting : pid=30921 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:53:46.350+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:53:46.400+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:53:46.749+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802026:749742][30921:0x7f2e0b135c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:53:46.749+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:53:46.761+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e0a065635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E0A044000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF204B7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E0AD1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E0AB18000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E0A81E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E0A609000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E0A3EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E0A044000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E0AF25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e0a065635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:53:46.761+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:54:46.099+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:54:46.106+0000 I CONTROL [initandlisten] MongoDB starting : pid=31145 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:54:46.107+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:54:46.156+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:54:46.594+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802086:594622][31145:0x7f1c1983ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:54:46.594+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:54:46.614+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c1876e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C1874D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C19425000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C19221000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C18F27000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C18D12000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C18AF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C1874D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C1962E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c1876e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:54:46.614+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:55:46.740+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] MongoDB starting : pid=31301 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:55:46.747+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:55:46.797+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:55:47.134+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802147:134806][31301:0x7faf61419c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:55:47.134+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:55:47.145+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf60349635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF60328000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8086000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF61000000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF60DFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF60B02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF608ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF606D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF60328000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF61209000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf60349635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:55:47.145+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:56:46.544+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:56:46.551+0000 I CONTROL [initandlisten] MongoDB starting : pid=31569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:56:46.552+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:56:46.602+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:56:46.892+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802206:892672][31569:0x7fe158eccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:56:46.892+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:56:46.903+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe157dfc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE157DDB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE158AB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1588AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1585B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1583A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE158183000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE157DDB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE158CBC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe157dfc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:56:46.903+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:57:47.024+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] MongoDB starting : pid=31772 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:57:47.033+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:57:47.085+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:57:47.473+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802267:473026][31772:0x7f190081ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:57:47.473+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:57:47.492+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18ff74a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18FF729000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE496000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1900401000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19001FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18FFF03000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18FFCEE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18FFAD1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18FF729000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F190060A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18ff74a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:57:47.492+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:58:46.621+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] MongoDB starting : pid=31997 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:58:46.628+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:58:46.678+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:58:47.024+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802327:24836][31997:0x7f4ceb144c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:58:47.024+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:58:47.038+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4cea074635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4CEA053000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF326FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4CEAD2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4CEAB27000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4CEA82D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4CEA618000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4CEA3FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4CEA053000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4CEAF34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4cea074635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:58:47.038+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T09:59:46.606+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=32217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] modules: none 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] build environment: 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T09:59:46.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T09:59:46.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T09:59:47.022+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802387:22504][32217:0x7fc7cb43cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T09:59:47.022+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T09:59:47.033+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7ca36c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7CA34B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF070FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7CB023000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7CAE1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7CAB25000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7CA910000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7CA6F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7CA34B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7CB22C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7ca36c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T09:59:47.033+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:00:46.145+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] MongoDB starting : pid=32385 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:00:46.152+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:00:46.202+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:00:46.630+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802446:630324][32385:0x7fe219c2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:00:46.630+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:00:46.649+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe218b5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE218B3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC3A8C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE219815000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE219611000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE219317000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE219102000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE218EE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE218B3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE219A1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe218b5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:00:46.649+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:01:46.083+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] MongoDB starting : pid=32640 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:01:46.091+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:01:46.141+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:01:46.494+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802506:494759][32640:0x7fa947103c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:01:46.494+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:01:46.508+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa946033635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA946012000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5FE4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA946CEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA946AE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9467EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9465D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9463BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA946012000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA946EF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa946033635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:01:46.508+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:02:46.359+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] MongoDB starting : pid=377 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:02:46.366+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:02:46.417+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:02:46.844+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802566:844750][377:0x7f6c301f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:02:46.844+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:02:46.865+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6c2f123635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6C2F102000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C2FDDA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C2FBD6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C2F8DC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C2F6C7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6C2F4AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6C2F102000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C2FFE3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6c2f123635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:02:46.865+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:03:46.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=587 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:03:46.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:03:47.046+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:03:47.451+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802627:451273][587:0x7f089d94bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:03:47.451+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:03:47.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f089c87b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F089C85A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F089D532000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F089D32E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F089D034000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F089CE1F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F089CC02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F089C85A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F089D73B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f089c87b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:03:47.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:04:46.130+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=811 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:04:46.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:04:46.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:04:46.585+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802686:585609][811:0x7f352d4f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:04:46.585+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:04:46.606+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f352c422635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F352C401000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6AA1D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F352D0D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F352CED5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F352CBDB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F352C9C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F352C7A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F352C401000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F352D2E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f352c422635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:04:46.606+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:05:46.735+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] MongoDB starting : pid=965 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:05:46.743+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:05:46.793+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:05:47.149+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802747:149327][965:0x7fa60d274c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:05:47.149+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:05:47.161+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa60c1a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA60C183000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA60CE5B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA60CC57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA60C95D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA60C748000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA60C52B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA60C183000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA60D064000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa60c1a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:05:47.161+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:06:46.531+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] MongoDB starting : pid=1227 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:06:46.538+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:06:46.591+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:06:47.007+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802807:7174][1227:0x7fa7e9d89c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:06:47.007+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:06:47.027+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7e8cb9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7E8C98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7E9970000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7E976C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7E9472000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7E925D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7E9040000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7E8C98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7E9B79000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7e8cb9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:06:47.027+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:07:46.155+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] MongoDB starting : pid=1426 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:07:46.162+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:07:46.163+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:07:46.213+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:07:46.655+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802866:655501][1426:0x7fc8c82e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:07:46.655+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:07:46.675+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8c7211635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8C71F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8C7EC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8C7CC4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8C79CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8C77B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8C7598000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8C71F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8C80D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8c7211635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:07:46.675+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:08:46.808+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=1644 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:08:46.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:08:46.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:08:47.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802927:276124][1644:0x7f4a612e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:08:47.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:08:47.295+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a60211635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A601F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A60EC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A60CC4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A609CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A607B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A60598000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A601F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A610D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a60211635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:08:47.295+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:09:46.612+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] MongoDB starting : pid=1866 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:09:46.620+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:09:46.671+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:09:47.035+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507802987:35807][1866:0x7ff5735c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:09:47.035+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:09:47.047+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff5724f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF5724D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6782C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF5731AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF572FA7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF572CAD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF572A98000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF57287B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF5724D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF5733B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff5724f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:09:47.047+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:10:46.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=2019 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:10:46.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:10:46.237+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:10:46.651+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803046:651419][2019:0x7f6ca7132c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:10:46.651+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:10:46.671+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6ca6062635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6CA6041000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5F6AF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6CA6D19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6CA6B15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6CA681B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6CA6606000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6CA63E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6CA6041000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6CA6F22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6ca6062635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:10:46.671+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:11:46.056+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] MongoDB starting : pid=2277 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:11:46.064+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:11:46.116+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:11:46.528+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803106:528110][2277:0x7f0c1855cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:11:46.528+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:11:46.547+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c1748c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C1746B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C6B4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C18143000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C17F3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C17C45000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C17A30000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C17813000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C1746B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C1834C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c1748c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:11:46.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:12:46.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] MongoDB starting : pid=2581 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:12:46.689+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:12:46.740+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:12:47.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803167:153664][2581:0x7fa35beb9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:12:47.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:12:47.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa35ade9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA35ADC8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA35BAA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA35B89C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA35B5A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA35B38D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA35B170000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA35ADC8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA35BCA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa35ade9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:12:47.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:13:46.298+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] MongoDB starting : pid=2798 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:13:46.306+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:13:46.357+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:13:46.772+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803226:772724][2798:0x7f59c09d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:13:46.772+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:13:46.792+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59bf906635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59BF8E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE96D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59C05BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59C03B9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59C00BF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59BFEAA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59BFC8D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59BF8E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59C07C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59bf906635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:13:46.792+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:14:46.891+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=3024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:14:46.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:14:46.948+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:14:47.323+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803287:323388][3024:0x7f17201a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:14:47.323+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:14:47.334+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f171f0d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F171F0B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF906FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F171FD88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F171FB84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F171F88A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F171F675000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F171F458000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F171F0B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F171FF91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f171f0d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:14:47.334+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:15:46.457+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] MongoDB starting : pid=3178 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:15:46.465+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:15:46.518+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:15:46.928+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803346:928271][3178:0x7fd94121dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:15:46.928+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:15:46.939+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd94014d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD94012C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB639000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD940E04000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD940C00000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD940906000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD9406F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD9404D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD94012C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD94100D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd94014d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:15:46.939+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:16:46.315+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:16:46.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=3457 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:16:46.322+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:16:46.323+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:16:46.373+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:16:46.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803406:775928][3457:0x7f9333935c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:16:46.776+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:16:46.795+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9332865635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9332844000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16BB6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F933351C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9333318000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F933301E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9332E09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9332BEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9332844000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9333725000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9332865635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:16:46.795+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:17:46.942+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] MongoDB starting : pid=3683 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:17:46.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:17:47.000+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:17:47.454+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803467:454076][3683:0x7f2491c2fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:17:47.454+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:17:47.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2490b5f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2490B3E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2491816000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2491612000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2491318000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2491103000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2490EE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2490B3E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2491A1F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2490b5f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:17:47.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:18:46.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] MongoDB starting : pid=3896 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:18:46.606+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:18:46.656+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:18:47.027+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803527:27969][3896:0x7f4063384c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:18:47.028+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:18:47.047+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40622b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4062293000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF202FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4062F6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4062D67000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4062A6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4062858000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F406263B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4062293000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4063174000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40622b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:18:47.047+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:19:46.077+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=4115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:19:46.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:19:46.110+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:19:46.451+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803586:451832][4115:0x7fb8bb9e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:19:46.451+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:19:46.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb8ba914635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB8BA8F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5005000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB8BB5CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB8BB3C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB8BB0CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB8BAEB8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB8BAC9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB8BA8F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB8BB7D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb8ba914635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:19:46.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:20:46.596+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] MongoDB starting : pid=4270 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:20:46.604+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:20:46.655+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:20:47.025+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803647:25642][4270:0x7f86415e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:20:47.025+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:20:47.036+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8640515635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86404F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF766FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86411CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8640FC8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8640CCE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8640AB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F864089C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86404F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86413D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8640515635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:20:47.036+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:21:46.427+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] MongoDB starting : pid=4380 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:21:46.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:21:46.487+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:21:46.874+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803706:874571][4380:0x7faddc980c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:21:46.874+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:21:46.893+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faddb8b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FADDB88F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7CE22000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FADDC567000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FADDC363000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FADDC069000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FADDBE54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FADDBC37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FADDB88F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FADDC770000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faddb8b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:21:46.893+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:22:47.018+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] MongoDB starting : pid=4647 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:22:47.026+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:22:47.074+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:22:47.485+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803767:485541][4647:0x7f185e2f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:22:47.485+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:22:47.505+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f185d223635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F185D202000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19087000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F185DEDA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F185DCD6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F185D9DC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F185D7C7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F185D5AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F185D202000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F185E0E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f185d223635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:22:47.505+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:23:46.635+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:23:46.642+0000 I CONTROL [initandlisten] MongoDB starting : pid=4865 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:23:46.642+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:23:46.643+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:23:46.692+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:23:47.032+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803827:32173][4865:0x7f6590d4bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:23:47.032+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:23:47.044+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f658fc7b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F658FC5A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21866000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6590932000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F659072E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6590434000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F659021F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6590002000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F658FC5A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6590B3B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f658fc7b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:23:47.044+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:24:46.289+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] MongoDB starting : pid=5298 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:24:46.297+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:24:46.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:24:46.742+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803886:742413][5298:0x7f0d1af49c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:24:46.742+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:24:46.762+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d19e79635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D19E58000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEB6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D1AB30000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D1A92C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D1A632000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D1A41D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D1A200000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D19E58000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D1AD39000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d19e79635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:24:46.762+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:25:46.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] MongoDB starting : pid=5661 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:25:46.901+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:25:46.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:25:47.231+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507803947:231179][5661:0x7f3520f8ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:25:47.231+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:25:47.241+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f351feba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F351FE99000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA199000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3520B71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F352096D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3520673000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F352045E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3520241000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F351FE99000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3520D7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f351feba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:25:47.241+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:26:46.756+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] MongoDB starting : pid=5892 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:26:46.769+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:26:46.818+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:26:47.154+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804007:154420][5892:0x7f7acf620c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:26:47.154+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:26:47.166+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ace550635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7ACE52F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6106000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7ACF207000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7ACF003000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7ACED09000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7ACEAF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7ACE8D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7ACE52F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7ACF410000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ace550635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:26:47.166+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:27:46.298+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=6268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:27:46.305+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:27:46.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:27:46.740+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804066:740093][6268:0x7f65f4950c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:27:46.740+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:27:46.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65f3880635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65F385F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65F4537000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65F4333000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65F4039000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65F3E24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65F3C07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65F385F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65F4740000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65f3880635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:27:46.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:28:46.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=6570 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:28:46.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:28:46.955+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:28:47.283+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804127:283690][6570:0x7fa9c80cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:28:47.283+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:28:47.303+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9c6ffa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9C6FD9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF368FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9C7CB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9C7AAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9C77B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9C759E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9C7381000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9C6FD9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9C7EBA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9c6ffa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:28:47.304+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:29:46.496+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] MongoDB starting : pid=6817 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:29:46.504+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:29:46.553+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:29:46.872+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804186:872187][6817:0x7f3f04819c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:29:46.872+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:29:46.883+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f03749635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F03728000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28A16000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F04400000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F041FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F03F02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F03CED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F03AD0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F03728000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F04609000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f03749635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:29:46.883+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:30:47.014+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] MongoDB starting : pid=7058 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:30:47.022+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:30:47.072+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:30:47.453+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804247:453172][7058:0x7f1d06681c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:30:47.453+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:30:47.473+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d055b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D05590000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D06268000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D06064000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D05D6A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D05B55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D05938000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D05590000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D06471000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d055b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:30:47.473+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:31:46.911+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:31:46.919+0000 I CONTROL [initandlisten] MongoDB starting : pid=7179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:31:46.919+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:31:46.919+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:31:46.919+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:31:46.919+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:31:46.919+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:31:46.920+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:31:46.920+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:31:46.920+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:31:46.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:31:47.373+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804307:373545][7179:0x7f642fb77c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:31:47.373+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:31:47.393+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f642eaa7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F642EA86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF158FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F642F75E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F642F55A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F642F260000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F642F04B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F642EE2E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F642EA86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F642F967000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f642eaa7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:31:47.393+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:32:46.508+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] MongoDB starting : pid=7435 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:32:46.515+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:32:46.566+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:32:46.854+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804366:854902][7435:0x7fcb22481c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:32:46.854+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:32:46.865+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb213b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB21390000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB22068000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB21E64000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB21B6A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB21955000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB21738000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB21390000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB22271000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb213b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:32:46.865+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:33:46.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:33:47.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=7641 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:33:47.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:33:47.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:33:47.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:33:47.002+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:33:47.003+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:33:47.003+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:33:47.003+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:33:47.003+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:33:47.053+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:33:47.327+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804427:327183][7641:0x7fc224d51c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:33:47.327+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:33:47.337+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc223c81635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC223C60000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9AC9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC224938000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC224734000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC22443A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC224225000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC224008000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC223C60000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC224B41000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc223c81635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:33:47.337+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:34:46.459+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] MongoDB starting : pid=7880 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:34:46.467+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:34:46.518+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:34:46.888+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804486:888691][7880:0x7f4d25414c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:34:46.888+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:34:46.907+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d24344635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D24323000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFADCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D24FFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D24DF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D24AFD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D248E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D246CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D24323000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D25204000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d24344635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:34:46.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:35:47.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] MongoDB starting : pid=8113 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:35:47.051+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:35:47.102+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:35:47.443+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804547:443808][8113:0x7f2d8ea00c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:35:47.443+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:35:47.463+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d8d930635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D8D90F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC17A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D8E5E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D8E3E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D8E0E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D8DED4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D8DCB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D8D90F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D8E7F0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d8d930635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:35:47.463+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:36:46.846+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:36:46.853+0000 I CONTROL [initandlisten] MongoDB starting : pid=8244 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:36:46.854+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:36:46.908+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:36:47.253+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804607:253911][8244:0x7ff1257b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:36:47.253+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:36:47.266+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1246e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1246C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1852000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF125399000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF125195000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF124E9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF124C86000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF124A69000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1246C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1255A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1246e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:36:47.266+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:37:46.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=8512 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:37:46.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:37:46.453+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:37:46.786+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804666:786599][8512:0x7f1002141c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:37:46.786+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:37:46.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1001071635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1001050000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF580FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1001D28000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1001B24000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F100182A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1001615000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10013F8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1001050000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1001F31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1001071635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:37:46.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:38:46.920+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] MongoDB starting : pid=8724 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:38:46.928+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:38:46.978+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:38:47.264+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804727:264181][8724:0x7fcc78a06c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:38:47.264+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:38:47.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcc77936635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCC77915000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0A6F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCC785ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCC783E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCC780EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCC77EDA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCC77CBD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCC77915000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCC787F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcc77936635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:38:47.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:39:46.400+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] MongoDB starting : pid=8943 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:39:46.408+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:39:46.463+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:39:46.879+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804786:879304][8943:0x7f267fa21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:39:46.879+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:39:46.899+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f267e951635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F267E930000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F267F608000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F267F404000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F267F10A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F267EEF5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F267ECD8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F267E930000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F267F811000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f267e951635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:39:46.899+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:40:46.889+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:40:46.896+0000 I CONTROL [initandlisten] MongoDB starting : pid=9173 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:40:46.897+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:40:46.946+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:40:47.259+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804847:259440][9173:0x7f8cec991c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:40:47.259+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:40:47.279+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ceb8c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8CEB8A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF67AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8CEC578000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8CEC374000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8CEC07A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8CEBE65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8CEBC48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8CEB8A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8CEC781000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ceb8c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:40:47.279+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:41:46.761+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] MongoDB starting : pid=9314 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:41:46.769+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:41:46.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:41:47.140+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804907:140175][9314:0x7fbae9929c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:41:47.140+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:41:47.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbae8859635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAE8838000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAE9510000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAE930C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAE9012000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAE8DFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAE8BE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAE8838000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAE9719000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbae8859635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:41:47.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:42:46.279+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] MongoDB starting : pid=9565 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:42:46.286+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:42:46.336+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:42:46.666+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507804966:666460][9565:0x7fdea555dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:42:46.666+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:42:46.676+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdea448d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDEA446C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5862000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDEA5144000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDEA4F40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDEA4C46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDEA4A31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDEA4814000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDEA446C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDEA534D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdea448d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:42:46.677+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:43:46.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=9790 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:43:46.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:43:46.870+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:43:47.192+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805027:192852][9790:0x7fcf8aaffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:43:47.192+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:43:47.203+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf89a2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF89A0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF8A6E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF8A4E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF8A1E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF89FD3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF89DB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF89A0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF8A8EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf89a2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:43:47.203+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:44:46.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=10009 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:44:46.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:44:46.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:44:46.761+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805086:761668][10009:0x7f255ffc8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:44:46.761+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:44:46.772+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f255eef8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F255EED7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58C15000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F255FBAF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F255F9AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F255F6B1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F255F49C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F255F27F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F255EED7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F255FDB8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f255eef8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:44:46.772+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:45:46.485+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=10240 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:45:46.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:45:46.544+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:45:46.916+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805146:916871][10240:0x7fd8ae613c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:45:46.916+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:45:46.936+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8ad543635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8AD522000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD8AE1FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD8ADFF6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD8ADCFC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD8ADAE7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD8AD8CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8AD522000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8AE403000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8ad543635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:45:46.936+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:46:46.363+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] MongoDB starting : pid=10376 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:46:46.372+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:46:46.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:46:46.758+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805206:758867][10376:0x7fea9cd12c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:46:46.758+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:46:46.769+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea9bc42635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA9BC21000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA9C8F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA9C6F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA9C3FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA9C1E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA9BFC9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA9BC21000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA9CB02000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea9bc42635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:46:46.769+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:47:46.891+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=10636 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:47:46.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:47:46.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:47:47.235+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805267:235170][10636:0x7f7675243c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:47:47.235+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:47:47.255+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7674173635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7674152000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E2AA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7674E2A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7674C26000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F767492C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7674717000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F76744FA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7674152000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7675033000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7674173635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:47:47.255+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:48:46.384+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=10843 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:48:46.392+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:48:46.443+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:48:46.831+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805326:831193][10843:0x7ffe8f0d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:48:46.831+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:48:46.850+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe8e008635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE8DFE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B4CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE8ECBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE8EABB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE8E7C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE8E5AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE8E38F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE8DFE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE8EEC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe8e008635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:48:46.850+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:49:46.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] MongoDB starting : pid=11062 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:49:46.978+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:49:47.030+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:49:47.343+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805387:343565][11062:0x7f3fccd2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:49:47.343+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:49:47.354+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3fcbc5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3FCBC3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FDCC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3FCC912000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3FCC70E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3FCC414000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3FCC1FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3FCBFE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3FCBC3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3FCCB1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3fcbc5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:49:47.354+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:50:46.817+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] MongoDB starting : pid=11293 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:50:46.824+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:50:46.825+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:50:46.825+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:50:46.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:50:47.150+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805447:150878][11293:0x7effd48aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:50:47.150+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:50:47.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7effd37da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFD37B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF716FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFD4491000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFD428D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFD3F93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFD3D7E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFD3B61000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFD37B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFD469A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7effd37da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:50:47.162+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:51:46.581+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:51:46.588+0000 I CONTROL [initandlisten] MongoDB starting : pid=11424 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:51:46.588+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:51:46.588+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:51:46.588+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:51:46.588+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:51:46.588+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:51:46.589+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:51:46.589+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:51:46.589+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:51:46.638+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:51:46.998+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805506:998308][11424:0x7f12657e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:51:46.998+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:51:47.017+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1264715635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12646F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12653CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12651C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1264ECE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1264CB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1264A9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12646F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12655D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1264715635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:51:47.017+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:52:46.141+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] MongoDB starting : pid=11677 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:52:46.148+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:52:46.198+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:52:46.486+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805566:486349][11677:0x7fc02e5abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:52:46.486+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:52:46.505+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc02d4db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC02D4BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC02E192000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC02DF8E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC02DC94000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC02DA7F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC02D862000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC02D4BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC02E39B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc02d4db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:52:46.505+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:53:46.642+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] MongoDB starting : pid=11885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:53:46.650+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:53:46.702+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:53:47.038+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805627:38118][11885:0x7f1ba3a40c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:53:47.038+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:53:47.050+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1ba2970635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1BA294F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCBCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1BA3627000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1BA3423000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1BA3129000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1BA2F14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1BA2CF7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1BA294F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1BA3830000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1ba2970635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:53:47.051+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:54:46.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] MongoDB starting : pid=12107 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:54:46.182+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:54:46.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:54:46.620+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805686:620725][12107:0x7f29df363c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:54:46.620+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:54:46.640+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29de293635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29DE272000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29DEF4A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29DED46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29DEA4C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29DE837000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29DE61A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29DE272000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29DF153000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29de293635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:54:46.640+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:55:46.894+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=12336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:55:46.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:55:46.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:55:47.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805747:291098][12336:0x7ff898275c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:55:47.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:55:47.305+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8971a5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF897184000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DDC9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF897E5C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF897C58000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF89795E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF897749000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF89752C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF897184000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF898065000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8971a5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:55:47.305+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:56:46.713+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] MongoDB starting : pid=12467 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:56:46.721+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:56:46.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:56:47.135+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805807:135269][12467:0x7f51dc690c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:56:47.135+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:56:47.147+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51db5c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51DB59F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF392DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51DC277000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51DC073000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51DBD79000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51DBB64000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51DB947000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51DB59F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51DC480000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51db5c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:56:47.147+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:57:46.269+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] MongoDB starting : pid=12578 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:57:46.277+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:57:46.327+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:57:46.656+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805866:656800][12578:0x7f85b14c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:57:46.656+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:57:46.678+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f85b03f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F85B03D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF528FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F85B10AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F85B0EA7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F85B0BAD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F85B0998000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F85B077B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F85B03D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F85B12B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f85b03f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:57:46.678+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:58:46.798+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] MongoDB starting : pid=12849 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:58:46.805+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:58:46.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:58:47.121+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805927:121983][12849:0x7f1bb8496c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:58:47.122+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:58:47.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1bb73c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1BB73A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1BB807D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1BB7E79000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1BB7B7F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1BB796A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1BB774D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1BB73A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1BB8286000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1bb73c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:58:47.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T10:59:46.265+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] MongoDB starting : pid=13066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] modules: none 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] build environment: 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T10:59:46.273+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T10:59:46.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T10:59:46.682+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507805986:682667][13066:0x7f896686ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T10:59:46.682+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T10:59:46.701+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f896579e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F896577D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA567E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8966455000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8966251000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8965F57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8965D42000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8965B25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F896577D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F896665E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f896579e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T10:59:46.702+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:00:46.408+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] MongoDB starting : pid=13310 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:00:46.416+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:00:46.468+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:00:46.773+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806046:773907][13310:0x7f01cce13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:00:46.774+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:00:46.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f01cbd43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F01CBD22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01CC9FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01CC7F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01CC4FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01CC2E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01CC0CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F01CBD22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F01CCC03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f01cbd43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:00:46.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:01:46.205+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] MongoDB starting : pid=13523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:01:46.213+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:01:46.263+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:01:46.614+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806106:614105][13523:0x7f2dd2273c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:01:46.614+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:01:46.624+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2dd11a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2DD1182000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF804FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2DD1E5A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2DD1C56000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2DD195C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2DD1747000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2DD152A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2DD1182000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2DD2063000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2dd11a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:01:46.624+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:02:46.112+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] MongoDB starting : pid=13644 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:02:46.119+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:02:46.171+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:02:46.454+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806166:454430][13644:0x7f546b499c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:02:46.454+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:02:46.466+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f546a3c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F546A3A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF63B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F546B080000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F546AE7C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F546AB82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F546A96D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F546A750000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F546A3A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F546B289000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f546a3c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:02:46.466+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:03:46.593+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=13903 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:03:46.601+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:03:46.650+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:03:47.040+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806227:40379][13903:0x7faa4b256c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:03:47.040+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:03:47.060+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa4a186635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA4A165000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE62B9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA4AE3D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA4AC39000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA4A93F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA4A72A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA4A50D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA4A165000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA4B046000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa4a186635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:03:47.060+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:04:46.198+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=14122 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:04:46.206+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:04:46.257+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:04:46.606+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806286:606496][14122:0x7f58411dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:04:46.606+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:04:46.627+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f584010e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58400ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF786FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5840DC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5840BC1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58408C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58406B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5840495000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58400ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5840FCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f584010e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:04:46.627+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:05:46.880+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] MongoDB starting : pid=14354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:05:46.887+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:05:46.937+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:05:47.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806347:266906][14354:0x7f69714a4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:05:47.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:05:47.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f69703d4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F69703B3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F697108B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6970E87000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6970B8D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6970978000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F697075B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F69703B3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6971294000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f69703d4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:05:47.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:06:46.722+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] MongoDB starting : pid=14900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:06:46.731+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:06:46.782+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:06:47.076+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806407:76871][14900:0x7f820896fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:06:47.076+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:06:47.087+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f820789f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F820787E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72AF3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8208556000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8208352000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8208058000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8207E43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8207C26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F820787E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F820875F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f820789f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:06:47.087+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:07:46.212+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] MongoDB starting : pid=15042 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:07:46.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:07:46.272+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:07:46.645+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806466:645978][15042:0x7fda95d67c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:07:46.646+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:07:46.665+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda94c97635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA94C76000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE099D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA9594E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA9574A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA95450000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA9523B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA9501E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA94C76000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA95B57000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda94c97635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:07:46.665+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:08:46.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] MongoDB starting : pid=15309 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:08:46.807+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:08:46.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:08:47.182+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806527:182631][15309:0x7f6b0f166c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:08:47.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:08:47.201+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b0e096635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B0E075000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B0ED4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B0EB49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B0E84F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B0E63A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B0E41D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B0E075000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B0EF56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b0e096635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:08:47.201+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:09:46.331+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] MongoDB starting : pid=15539 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:09:46.338+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:09:46.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:09:46.678+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806586:678227][15539:0x7fb455dcfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:09:46.678+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:09:46.697+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb454cff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB454CDE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B4E2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB4559B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB4557B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB4554B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB4552A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB455086000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB454CDE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB455BBF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb454cff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:09:46.697+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:10:47.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=15769 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:10:47.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:10:47.104+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:10:47.456+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806647:456310][15769:0x7f99c6e58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:10:47.456+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:10:47.475+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99c5d88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99C5D67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B4F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99C6A3F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99C683B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99C6541000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99C632C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99C610F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99C5D67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99C6C48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99c5d88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:10:47.475+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:11:46.873+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:11:46.880+0000 I CONTROL [initandlisten] MongoDB starting : pid=15991 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:11:46.881+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:11:46.932+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:11:47.262+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806707:262483][15991:0x7f07f9a8cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:11:47.262+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:11:47.273+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f07f89bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F07F899B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF066FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F07F9673000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F07F946F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F07F9175000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F07F8F60000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F07F8D43000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F07F899B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F07F987C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f07f89bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:11:47.273+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:12:46.403+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] MongoDB starting : pid=16108 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:12:46.413+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:12:46.464+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:12:46.747+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806766:747921][16108:0x7fb598497c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:12:46.747+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:12:46.758+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb5973c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB5973A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7AA8E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB59807E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB597E7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB597B80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB59796B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB59774E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5973A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB598287000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb5973c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:12:46.758+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:13:46.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=16386 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:13:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:13:46.891+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:13:46.941+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:13:47.323+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806827:323168][16386:0x7f0fa466ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:13:47.323+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:13:47.342+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fa359e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FA357D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FA4255000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FA4051000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FA3D57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FA3B42000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FA3925000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FA357D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FA445E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fa359e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:13:47.342+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:14:46.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=16610 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:14:46.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:14:46.521+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:14:46.889+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806886:889213][16610:0x7f776291dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:14:46.889+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:14:46.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f776184d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F776182C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7762504000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7762300000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7762006000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7761DF1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7761BD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F776182C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F776270D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f776184d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:14:46.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:15:46.441+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] MongoDB starting : pid=16839 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:15:46.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:15:46.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:15:46.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507806946:783940][16839:0x7f14bbf9ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:15:46.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:15:46.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14baece635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14BAEAD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB58AA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F14BBB85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F14BB981000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F14BB687000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F14BB472000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F14BB255000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14BAEAD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F14BBD8E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14baece635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:15:46.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:16:46.264+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] MongoDB starting : pid=17057 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:16:46.272+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:16:46.327+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:16:46.732+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807006:732724][17057:0x7fa698abbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:16:46.732+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:16:46.753+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6979eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6979CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF792FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6986A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA69849E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6981A4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA697F8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA697D72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6979CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6988AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6979eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:16:46.753+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:17:46.879+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=17172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:17:46.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:17:46.936+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:17:47.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807067:318932][17172:0x7f0a397cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:17:47.319+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:17:47.338+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a386fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A386DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE48EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A393B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A391B1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A38EB7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A38CA2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A38A85000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A386DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A395BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a386fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:17:47.338+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:18:46.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=17434 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:18:46.477+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:18:46.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:18:46.802+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807126:802207][17434:0x7f0eb986fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:18:46.802+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:18:46.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0eb879f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EB877E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EB9456000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EB9252000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EB8F58000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EB8D43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EB8B26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EB877E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EB965F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0eb879f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:18:46.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:19:46.938+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] MongoDB starting : pid=17657 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:19:46.946+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:19:46.996+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:19:47.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807187:338589][17657:0x7fbd6a0bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:19:47.338+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:19:47.352+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbd68feb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBD68FCA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA40FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBD69CA2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBD69A9E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBD697A4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBD6958F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBD69372000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBD68FCA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBD69EAB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbd68feb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:19:47.352+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:20:46.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] MongoDB starting : pid=17889 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:20:46.582+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:20:46.631+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:20:46.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807246:910752][17889:0x7f7107888c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:20:46.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:20:46.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f71067b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7106797000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42A18000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F710746F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F710726B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7106F71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7106D5C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7106B3F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7106797000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7107678000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f71067b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:20:46.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:21:46.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=18102 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:21:46.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:21:46.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:21:46.680+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807306:680584][18102:0x7fe1a6829c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:21:46.680+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:21:46.691+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1a5759635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1A5738000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D7C5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1A6410000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1A620C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1A5F12000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1A5CFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1A5AE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1A5738000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1A6619000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1a5759635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:21:46.691+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:22:46.819+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:22:46.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=18219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:22:46.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:22:46.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:22:46.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:22:46.828+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:22:46.828+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:22:46.828+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:22:46.828+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:22:46.828+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:22:46.878+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:22:47.174+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807367:174755][18219:0x7fba9f567c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:22:47.174+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:22:47.185+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba9e497635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA9E476000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF570DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA9F14E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA9EF4A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA9EC50000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA9EA3B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA9E81E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA9E476000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA9F357000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba9e497635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:22:47.185+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:23:46.308+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] MongoDB starting : pid=18479 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:23:46.316+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:23:46.367+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:23:46.744+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807426:744696][18479:0x7f8709c57c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:23:46.744+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:23:46.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8708b87635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8708B66000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EEDA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F870983E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F870963A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8709340000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F870912B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8708F0E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8708B66000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8709A47000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8708b87635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:23:46.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:24:46.907+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] MongoDB starting : pid=18703 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:24:46.914+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:24:46.965+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:24:47.257+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807487:257293][18703:0x7fbc56ea7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:24:47.257+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:24:47.267+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc55dd7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC55DB6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC56A8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC5688A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC56590000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC5637B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC5615E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC55DB6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC56C97000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc55dd7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:24:47.267+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:25:46.825+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=18949 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:25:46.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:25:46.885+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:25:47.275+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807547:275293][18949:0x7fc167e19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:25:47.275+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:25:47.294+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc166d49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC166D28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD47B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC167A00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC1677FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC167502000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1672ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC1670D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC166D28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC167C09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc166d49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:25:47.294+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:26:46.735+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] MongoDB starting : pid=19170 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:26:46.742+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:26:46.793+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:26:47.125+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807607:125346][19170:0x7f954df3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:26:47.125+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:26:47.146+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f954ce6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F954CE49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F954DB21000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F954D91D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F954D623000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F954D40E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F954D1F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F954CE49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F954DD2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f954ce6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:26:47.146+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:27:46.272+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] MongoDB starting : pid=19286 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:27:46.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:27:46.329+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:27:46.665+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807666:665249][19286:0x7f406fa7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:27:46.665+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:27:46.684+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f406e9ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F406E98A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF44072000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F406F662000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F406F45E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F406F164000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F406EF4F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F406ED32000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F406E98A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F406F86B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f406e9ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:27:46.684+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:28:46.803+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] MongoDB starting : pid=19555 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:28:46.811+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:28:46.861+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:28:47.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807727:243293][19555:0x7fcc77fc2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:28:47.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:28:47.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcc76ef2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCC76ED1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39D87000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCC77BA9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCC779A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCC776AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCC77496000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCC77279000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCC76ED1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCC77DB2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcc76ef2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:28:47.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:29:46.383+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:29:46.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=19774 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:29:46.393+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:29:46.447+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:29:46.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807786:828676][19774:0x7f44c3b55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:29:46.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:29:46.840+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44c2a85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44C2A64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAEEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44C373C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44C3538000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44C323E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44C3029000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44C2E0C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44C2A64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44C3945000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44c2a85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:29:46.840+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:30:46.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=20003 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:30:47.001+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:30:47.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:30:47.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807847:429043][20003:0x7fd7da4d4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:30:47.429+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:30:47.449+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7d9404635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7D93E3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4831E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7DA0BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7D9EB7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7D9BBD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7D99A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7D978B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7D93E3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7DA2C4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7d9404635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:30:47.450+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:31:46.881+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=20221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:31:46.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:31:46.943+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:31:47.313+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807907:313909][20221:0x7ff06e6fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:31:47.313+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:31:47.324+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff06d62b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF06D60A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF06E2E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF06E0DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF06DDE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF06DBCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF06D9B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF06D60A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF06E4EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff06d62b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:31:47.324+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:32:46.458+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] MongoDB starting : pid=20331 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:32:46.466+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:32:46.517+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:32:46.881+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507807966:881470][20331:0x7f58fe0d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:32:46.881+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:32:46.892+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58fd001635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58FCFE0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF612FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58FDCB8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58FDAB4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58FD7BA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58FD5A5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58FD388000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58FCFE0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58FDEC1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58fd001635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:32:46.892+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:33:47.011+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] MongoDB starting : pid=20456 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:33:47.020+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:33:47.070+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:33:47.375+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808027:375256][20456:0x7fae725e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:33:47.375+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:33:47.385+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fae71518635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAE714F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0472000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAE721CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAE71FCB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAE71CD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAE71ABC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAE7189F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAE714F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAE723D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fae71518635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:33:47.385+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:34:46.503+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] MongoDB starting : pid=20728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:34:46.513+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:34:46.563+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:34:46.887+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808086:887204][20728:0x7fda773cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:34:46.887+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:34:46.897+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda762fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA762D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA76FB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA76DAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA76AB3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA7689E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA76681000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA762D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA771BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda762fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:34:46.897+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:35:46.157+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:35:46.164+0000 I CONTROL [initandlisten] MongoDB starting : pid=20969 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:35:46.165+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:35:46.217+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:35:46.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808146:561473][20969:0x7fa547c41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:35:46.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:35:46.577+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa546b71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA546B50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF164FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA547828000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA547624000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA54732A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA547115000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA546EF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA546B50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA547A31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa546b71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:35:46.578+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:36:47.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] MongoDB starting : pid=21200 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:36:47.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:36:47.063+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:36:47.433+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808207:433150][21200:0x7fcc5f904c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:36:47.433+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:36:47.443+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcc5e834635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCC5E813000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCC5F4EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCC5F2E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCC5EFED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCC5EDD8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCC5EBBB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCC5E813000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCC5F6F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcc5e834635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:36:47.444+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:37:46.562+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] MongoDB starting : pid=21397 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:37:46.570+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:37:46.620+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:37:46.914+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808266:913988][21397:0x7fb179b86c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:37:46.914+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:37:46.924+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb178ab6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB178A95000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF538FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB17976D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB179569000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB17926F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB17905A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB178E3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB178A95000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB179976000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb178ab6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:37:46.924+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:38:46.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] MongoDB starting : pid=21523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:38:46.063+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:38:46.114+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:38:46.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808326:395756][21523:0x7f58239bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:38:46.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:38:46.406+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58228ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58228C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1A55000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58235A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F582339D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58230A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5822E8E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5822C71000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58228C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58237AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58228ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:38:46.406+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:39:46.531+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] MongoDB starting : pid=21809 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:39:46.539+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:39:46.588+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:39:46.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808386:910003][21809:0x7f4a79d23c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:39:46.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:39:46.920+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a78c53635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A78C32000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CAD3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A7990A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A79706000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A7940C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A791F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A78FDA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A78C32000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A79B13000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a78c53635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:39:46.920+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:40:46.312+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] MongoDB starting : pid=22017 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:40:46.320+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:40:46.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:40:46.740+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808446:740041][22017:0x7fc662c7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:40:46.740+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:40:46.760+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc661bad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC661B8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF450FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC662864000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC662660000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC662366000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC662151000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC661F34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC661B8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC662A6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc661bad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:40:46.760+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:41:46.214+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] MongoDB starting : pid=22262 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:41:46.222+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:41:46.273+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:41:46.640+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808506:640702][22262:0x7f5227d1cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:41:46.640+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:41:46.651+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5226c4c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5226C2B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF87236000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5227903000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52276FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5227405000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52271F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5226FD3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5226C2B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5227B0C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5226c4c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:41:46.651+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:42:46.782+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] MongoDB starting : pid=22465 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:42:46.790+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:42:46.840+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:42:47.219+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808567:219470][22465:0x7fd4532bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:42:47.219+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:42:47.239+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4521ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4521CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD452EA5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD452CA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD4529A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD452792000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD452575000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4521CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4530AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4521ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:42:47.239+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:43:46.372+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] MongoDB starting : pid=22601 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:43:46.380+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:43:46.431+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:43:46.845+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808626:845240][22601:0x7f9364334c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:43:46.845+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:43:46.864+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9363264635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9363243000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF930FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9363F1B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9363D17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9363A1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9363808000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93635EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9363243000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9364124000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9363264635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:43:46.864+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:44:46.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:44:46.994+0000 I CONTROL [initandlisten] MongoDB starting : pid=22876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:44:46.994+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:44:46.994+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:44:46.994+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:44:46.994+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:44:46.995+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:44:46.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:44:46.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:44:46.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:44:47.048+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:44:47.465+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808687:465103][22876:0x7f67c40a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:44:47.465+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:44:47.484+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67c2fd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67C2FB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFABAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67C3C88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67C3A84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67C378A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67C3575000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67C3358000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67C2FB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67C3E91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67c2fd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:44:47.484+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:45:46.642+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] MongoDB starting : pid=23081 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:45:46.650+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:45:46.700+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:45:47.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808747:70422][23081:0x7fafc1eb8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:45:47.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:45:47.091+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fafc0de8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAFC0DC7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C899000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAFC1A9F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAFC189B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAFC15A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAFC138C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAFC116F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAFC0DC7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAFC1CA8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fafc0de8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:45:47.091+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:46:46.514+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=23320 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:46:46.522+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:46:46.571+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:46:46.886+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808806:886043][23320:0x7f436b294c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:46:46.886+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:46:46.897+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f436a1c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F436A1A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F436AE7B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F436AC77000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F436A97D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F436A768000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F436A54B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F436A1A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F436B084000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f436a1c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:46:46.897+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:47:47.023+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] MongoDB starting : pid=23520 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:47:47.031+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:47:47.080+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:47:47.379+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808867:379243][23520:0x7f8cace24c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:47:47.379+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:47:47.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8cabd54635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8CABD33000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF44C12000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8CACA0B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8CAC807000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8CAC50D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8CAC2F8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8CAC0DB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8CABD33000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8CACC14000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8cabd54635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:47:47.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:48:46.511+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] MongoDB starting : pid=23652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:48:46.521+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:48:46.570+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:48:46.826+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808926:826313][23652:0x7f2ed6725c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:48:46.826+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:48:46.842+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ed5655635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2ED5634000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0069000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2ED630C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2ED6108000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2ED5E0E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2ED5BF9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2ED59DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2ED5634000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2ED6515000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ed5655635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:48:46.842+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:49:46.962+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:49:46.969+0000 I CONTROL [initandlisten] MongoDB starting : pid=23922 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:49:46.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:49:47.019+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:49:47.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507808987:410370][23922:0x7fe5478b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:49:47.410+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:49:47.430+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe5467e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5467C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C4CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE54749A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE547296000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE546F9C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE546D87000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE546B6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5467C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE5476A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe5467e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:49:47.430+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:50:46.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] MongoDB starting : pid=24125 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:50:46.832+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:50:46.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:50:47.185+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809047:185077][24125:0x7fd87d52cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:50:47.185+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:50:47.195+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd87c45c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD87C43B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD35BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD87D113000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD87CF0F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD87CC15000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD87CA00000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD87C7E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD87C43B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD87D31C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd87c45c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:50:47.195+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:51:46.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=24375 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:51:46.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:51:46.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:51:47.042+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809107:42269][24375:0x7f439c6b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:51:47.042+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:51:47.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f439b5e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F439B5C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F439C2A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F439C09C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F439BDA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F439BB8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F439B970000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F439B5C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F439C4A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f439b5e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:51:47.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:52:46.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] MongoDB starting : pid=24574 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:52:46.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:52:46.240+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:52:46.617+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809166:617701][24574:0x7f47725ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:52:46.617+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:52:46.637+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f477152f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F477150E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60BD5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F47721E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4771FE2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4771CE8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4771AD3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47718B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F477150E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47723EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f477152f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:52:46.637+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:53:46.759+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] MongoDB starting : pid=24699 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:53:46.767+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:53:46.817+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:53:47.186+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809227:186327][24699:0x7f60d608fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:53:47.186+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:53:47.206+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f60d4fbf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F60D4F9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E400000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F60D5C76000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F60D5A72000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F60D5778000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F60D5563000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F60D5346000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F60D4F9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F60D5E7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f60d4fbf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:53:47.206+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:54:46.334+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=24973 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:54:46.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:54:46.393+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:54:46.729+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809286:729095][24973:0x7ff8d03f5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:54:46.729+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:54:46.749+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8cf325635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF8CF304000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8CFFDC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8CFDD8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8CFADE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF8CF8C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF8CF6AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF8CF304000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF8D01E5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8cf325635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:54:46.749+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:55:47.041+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=25171 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:55:47.049+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:55:47.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:55:47.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809347:395795][25171:0x7f151a4b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:55:47.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:55:47.406+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15193e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15193C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F151A09D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1519E99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1519B9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F151998A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F151976D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15193C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F151A2A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15193e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:55:47.406+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:56:46.806+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=25420 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:56:46.814+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:56:46.864+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:56:47.254+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809407:253993][25420:0x7f8672c83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:56:47.254+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:56:47.274+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8671bb3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8671B92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6AAC4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F867286A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8672666000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F867236C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8672157000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8671F3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8671B92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8672A73000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8671bb3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:56:47.274+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:57:46.399+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:57:46.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=25622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:57:46.407+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:57:46.456+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:57:46.776+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809466:776670][25622:0x7feef34d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:57:46.776+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:57:46.787+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feef2407635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEEF23E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEEF30BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEEF2EBA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEEF2BC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEEF29AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEEF278E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEEF23E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEEF32C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feef2407635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:57:46.787+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:58:46.911+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] MongoDB starting : pid=25758 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:58:46.918+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:58:46.968+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:58:47.293+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809527:293525][25758:0x7fb9a5361c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:58:47.293+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:58:47.304+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb9a4291635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB9A4270000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF48F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB9A4F48000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB9A4D44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB9A4A4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB9A4835000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9A4618000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB9A4270000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB9A5151000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb9a4291635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:58:47.304+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T11:59:46.431+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] MongoDB starting : pid=26026 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] modules: none 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] build environment: 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T11:59:46.437+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T11:59:46.474+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T11:59:46.842+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809586:842565][26026:0x7ff309679c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T11:59:46.842+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T11:59:46.861+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3085a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF308588000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDCBA7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF309260000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF30905C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF308D62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF308B4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF308930000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF308588000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF309469000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3085a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T11:59:46.861+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:00:46.693+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] MongoDB starting : pid=26284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:00:46.703+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:00:46.753+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:00:47.137+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809647:137508][26284:0x7fdd08d80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:00:47.137+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:00:47.157+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd07cb0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD07C8F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD425000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD08967000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD08763000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD08469000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD08254000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD08037000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD07C8F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD08B70000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd07cb0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:00:47.157+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:01:46.566+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] MongoDB starting : pid=26527 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:01:46.574+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:01:46.630+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:01:47.030+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809707:30536][26527:0x7f77f68c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:01:47.030+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:01:47.049+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f77f57f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F77F57D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F77F64AC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F77F62A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F77F5FAE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F77F5D99000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F77F5B7C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F77F57D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F77F66B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f77f57f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:01:47.049+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:02:46.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:02:46.621+0000 I CONTROL [initandlisten] MongoDB starting : pid=26732 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:02:46.622+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:02:46.671+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:02:47.067+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809767:67063][26732:0x7f3357688c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:02:47.067+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:02:47.086+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33565b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3356597000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B0FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F335726F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F335706B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3356D71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3356B5C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F335693F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3356597000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3357478000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33565b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:02:47.086+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:03:46.204+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] MongoDB starting : pid=26854 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:03:46.212+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:03:46.262+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:03:46.690+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809826:690968][26854:0x7fde4d31ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:03:46.691+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:03:46.710+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde4c24e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE4C22D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDEE12000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE4CF05000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE4CD01000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE4CA07000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE4C7F2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE4C5D5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE4C22D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE4D10E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde4c24e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:03:46.710+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:04:46.835+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:04:46.843+0000 I CONTROL [initandlisten] MongoDB starting : pid=27132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:04:46.844+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:04:46.894+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:04:47.292+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809887:292667][27132:0x7f8e6068bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:04:47.292+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:04:47.314+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e5f5bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E5F59A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD81E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E60272000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E6006E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E5FD74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E5FB5F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E5F942000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E5F59A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E6047B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e5f5bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:04:47.314+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:05:46.856+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] MongoDB starting : pid=27337 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:05:46.864+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:05:46.916+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:05:47.334+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507809947:334953][27337:0x7fc867ddfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:05:47.335+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:05:47.354+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc866d0f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC866CEE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF37CC4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8679C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8677C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8674C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8672B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC867096000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC866CEE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC867BCF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc866d0f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:05:47.354+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:06:46.728+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] MongoDB starting : pid=27574 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:06:46.736+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:06:46.785+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:06:47.176+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810007:176204][27574:0x7fd7ef267c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:06:47.176+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:06:47.197+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7ee197635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7EE176000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7EEE4E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7EEC4A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7EE950000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7EE73B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7EE51E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7EE176000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7EF057000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7ee197635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:06:47.197+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:07:46.333+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:07:46.340+0000 I CONTROL [initandlisten] MongoDB starting : pid=27740 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:07:46.340+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:07:46.341+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:07:46.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:07:46.746+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810066:746641][27740:0x7f0e9174bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:07:46.746+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:07:46.766+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e9067b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E9065A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD407000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E91332000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E9112E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E90E34000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E90C1F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E90A02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E9065A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E9153B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e9067b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:07:46.766+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:08:46.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=27893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:08:46.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:08:46.940+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:08:47.297+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810127:297064][27893:0x7f0bc548dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:08:47.297+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:08:47.309+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0bc43bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0BC439C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF73EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0BC5074000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0BC4E70000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0BC4B76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0BC4961000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0BC4744000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0BC439C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0BC527D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0bc43bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:08:47.309+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:09:46.432+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] MongoDB starting : pid=28014 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:09:46.440+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:09:46.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:09:46.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810186:915393][28014:0x7f473d70bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:09:46.915+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:09:46.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f473c63b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F473C61A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F473D2F2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F473D0EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F473CDF4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F473CBDF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F473C9C2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F473C61A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F473D4FB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f473c63b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:09:46.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:10:46.070+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:10:46.077+0000 I CONTROL [initandlisten] MongoDB starting : pid=28284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:10:46.077+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:10:46.077+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:10:46.078+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:10:46.078+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:10:46.078+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:10:46.078+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:10:46.078+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:10:46.078+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:10:46.128+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:10:46.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810246:559141][28284:0x7f61bb8efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:10:46.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:10:46.578+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61ba81f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61BA7FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E65B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61BB4D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61BB2D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61BAFD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61BADC3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61BABA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61BA7FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61BB6DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61ba81f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:10:46.578+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:11:46.478+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=28514 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:11:46.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:11:46.538+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:11:46.934+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810306:934036][28514:0x7ffd4988bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:11:46.934+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:11:46.944+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd487bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD4879A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F21A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD49472000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD4926E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD48F74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD48D5F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD48B42000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD4879A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD4967B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd487bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:11:46.944+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:12:46.075+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=28805 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:12:46.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:12:46.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:12:46.542+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810366:542667][28805:0x7f02aad46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:12:46.542+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:12:46.562+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f02a9c76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F02A9C55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0AD6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F02AA92D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F02AA729000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F02AA42F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02AA21A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02A9FFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F02A9C55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F02AAB36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f02a9c76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:12:46.562+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:13:46.690+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] MongoDB starting : pid=29028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:13:46.698+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:13:46.749+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:13:47.071+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810427:71256][29028:0x7fc1309a6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:13:47.071+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:13:47.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc12f8d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC12F8B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC13058D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC130389000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC13008F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC12FE7A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC12FC5D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC12F8B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC130796000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc12f8d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:13:47.082+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:14:46.202+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=29144 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:14:46.210+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:14:46.260+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:14:46.638+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810486:638014][29144:0x7f54c9583c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:14:46.638+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:14:46.657+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54c84b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54C8492000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF994F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54C916A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54C8F66000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F54C8C6C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54C8A57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54C883A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54C8492000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54C9373000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54c84b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:14:46.657+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:15:46.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] MongoDB starting : pid=29459 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:15:46.797+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:15:46.847+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:15:47.172+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810547:172476][29459:0x7fbdb32eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:15:47.172+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:15:47.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbdb221e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBDB21FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF884E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBDB2ED5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBDB2CD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBDB29D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBDB27C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBDB25A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBDB21FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBDB30DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbdb221e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:15:47.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:16:46.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=29694 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:16:46.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:16:46.832+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:16:47.128+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810607:128706][29694:0x7fd5e3d7fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:16:47.128+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:16:47.148+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5e2caf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5E2C8E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA58C2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD5E3966000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5E3762000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5E3468000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5E3253000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5E3036000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5E2C8E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5E3B6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5e2caf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:16:47.148+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:17:46.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=29917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:17:46.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:17:46.275+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:17:46.325+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:17:46.658+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810666:658470][29917:0x7f14cdeafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:17:46.658+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:17:46.670+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14ccddf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14CCDBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2BC85000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F14CDA96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F14CD892000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F14CD598000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F14CD383000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F14CD166000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14CCDBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F14CDC9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14ccddf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:17:46.670+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:18:46.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=30128 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:18:46.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:18:46.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:18:47.201+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810727:201037][30128:0x7fb947049c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:18:47.201+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:18:47.220+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb945f79635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB945F58000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2818000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB946C30000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB946A2C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB946732000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB94651D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB946300000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB945F58000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB946E39000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb945f79635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:18:47.220+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:19:46.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:19:46.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=30243 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:19:46.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:19:46.347+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:19:46.398+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:19:46.746+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810786:746043][30243:0x7f10acdc0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:19:46.746+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:19:46.756+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f10abcf2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F10ABCD1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F10AD6D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10AC9A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10AC7A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10AC4AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10AC296000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10AC079000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F10ABCD1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F10ACBB2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f10abcf2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:19:46.756+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:20:46.896+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] MongoDB starting : pid=30515 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:20:46.904+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:20:46.956+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:20:47.316+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810847:316630][30515:0x7fb3bed2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:20:47.316+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:20:47.327+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb3bdc5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB3BDC3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB3BE912000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB3BE70E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB3BE414000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB3BE1FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB3BDFE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB3BDC3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB3BEB1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb3bdc5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:20:47.327+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:21:46.092+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] MongoDB starting : pid=30747 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:21:46.100+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:21:46.149+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:21:46.504+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810906:504663][30747:0x7fc08b2fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:21:46.504+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:21:46.524+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc08a22c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC08A20B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF742FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC08AEE3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC08ACDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC08A9E5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC08A7D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC08A5B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC08A20B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC08B0EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc08a22c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:21:46.524+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:22:46.654+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] MongoDB starting : pid=30960 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:22:46.663+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:22:46.664+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:22:46.715+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:22:47.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507810967:92124][30960:0x7f00dfd87c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:22:47.092+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:22:47.103+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00decb9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00DEC98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F00E0698000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00DF970000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00DF76C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00DF472000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00DF25D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00DF040000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00DEC98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00DFB79000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00decb9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:22:47.103+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:23:46.218+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] MongoDB starting : pid=31167 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:23:46.226+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:23:46.275+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:23:46.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811026:668521][31167:0x7fd4f1c2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:23:46.668+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:23:46.688+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4f0b5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4F0B3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD4F1815000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD4F1611000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD4F1317000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD4F1102000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD4F0EE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4F0B3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4F1A1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4f0b5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:23:46.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:24:46.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=31287 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:24:46.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:24:46.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:24:47.241+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811087:241598][31287:0x7f329aa4ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:24:47.241+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:24:47.252+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f329997e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F329995D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFACCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F329A635000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F329A431000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F329A137000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3299F22000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3299D05000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F329995D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F329A83E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f329997e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:24:47.252+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:25:46.383+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:25:46.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=31559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:25:46.391+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:25:46.450+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:25:46.777+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811146:777060][31559:0x7f09dd4bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:25:46.777+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:25:46.787+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09dc3eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09DC3CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF808FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09DD0A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09DCE9E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09DCBA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09DC98F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09DC772000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09DC3CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09DD2AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09dc3eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:25:46.787+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:26:46.207+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] MongoDB starting : pid=31799 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:26:46.215+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:26:46.270+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:26:46.577+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811206:577010][31799:0x7fdff4ac2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:26:46.577+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:26:46.587+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdff39f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFF39D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF05CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFF46A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFF44A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFF41AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFF3F96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFF3D79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFF39D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFF48B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdff39f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:26:46.587+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:27:46.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] MongoDB starting : pid=32009 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:27:46.722+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:27:46.772+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:27:47.112+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811267:112477][32009:0x7f3da40ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:27:47.112+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:27:47.123+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3da2ffc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DA2FDB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DA3CB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DA3AAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DA37B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DA35A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DA3383000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DA2FDB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DA3EBC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3da2ffc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:27:47.123+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:28:46.250+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] MongoDB starting : pid=32227 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:28:46.257+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:28:46.307+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:28:46.587+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811326:587530][32227:0x7f547cdbec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:28:46.587+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:28:46.598+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f547bcee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F547BCCD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FCF2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F547C9A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F547C7A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F547C4A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F547C292000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F547C075000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F547BCCD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F547CBAE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f547bcee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:28:46.598+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:29:46.731+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] MongoDB starting : pid=32344 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:29:46.739+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:29:46.789+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:29:47.128+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811387:128041][32344:0x7f3bca589c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:29:47.128+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:29:47.138+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3bc94b9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3BC9498000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF68FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BCA170000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BC9F6C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BC9C72000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BC9A5D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BC9840000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BC9498000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BCA379000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3bc94b9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:29:47.138+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:30:46.263+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] MongoDB starting : pid=32625 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:30:46.270+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:30:46.320+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:30:46.589+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811446:589450][32625:0x7f41389e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:30:46.589+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:30:46.599+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4137910635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41378EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F41385C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F41383C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41380C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4137EB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4137C97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41378EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41387D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4137910635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:30:46.599+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:31:46.495+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] MongoDB starting : pid=397 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:31:46.503+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:31:46.553+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:31:46.923+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811506:923753][397:0x7fc808f0fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:31:46.923+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:31:46.943+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc807e3f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC807E1E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF358FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC808AF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8088F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8085F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8083E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8081C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC807E1E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC808CFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc807e3f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:31:46.943+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:32:46.078+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] MongoDB starting : pid=613 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:32:46.086+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:32:46.136+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:32:46.520+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811566:520746][613:0x7fb997884c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:32:46.520+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:32:46.540+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb9967b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB996795000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FB998195000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB99746D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB997269000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB996F6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB996D5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB996B3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB996795000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB997676000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb9967b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:32:46.540+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:33:46.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:33:46.674+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:33:46.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:33:46.987+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811626:987471][822:0x7fb605260c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:33:46.987+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:33:46.997+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb604190635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB60416F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF330FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB604E47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB604C43000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB604949000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB604734000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB604517000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB60416F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB605050000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb604190635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:33:46.997+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:34:46.120+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] MongoDB starting : pid=940 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:34:46.128+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:34:46.183+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:34:46.545+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811686:545275][940:0x7ff997edec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:34:46.545+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:34:46.555+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff996e0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF996DED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06CE2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF997AC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9978C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9975C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9973B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF997195000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF996DED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF997CCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff996e0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:34:46.555+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:35:46.806+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=1212 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:35:46.814+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:35:46.864+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:35:47.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811747:240113][1212:0x7f36d1c37c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:35:47.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:35:47.250+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36d0b67635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36D0B46000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2E89000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36D181E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36D161A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36D1320000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36D110B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36D0EEE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36D0B46000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36D1A27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36d0b67635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:35:47.250+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:36:46.663+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=1445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:36:46.674+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:36:46.727+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:36:47.066+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811807:66129][1445:0x7f90f0e3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:36:47.066+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:36:47.079+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90efd6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90EFD4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC34FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90F0A23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90F081F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90F0525000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90F0310000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90F00F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90EFD4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90F0C2C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90efd6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:36:47.079+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:37:46.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:37:46.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=1653 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:37:46.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:37:46.262+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:37:46.563+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811866:563784][1653:0x7f9a3ec1dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:37:46.563+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:37:46.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a3db4d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A3DB2C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5EAEB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A3E804000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A3E600000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A3E306000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A3E0F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A3DED4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A3DB2C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A3EA0D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a3db4d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:37:46.582+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:38:46.703+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] MongoDB starting : pid=1866 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:38:46.711+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:38:46.761+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:38:47.074+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811927:74938][1866:0x7f426acb1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:38:47.075+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:38:47.086+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4269be1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4269BC0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B969000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F426A898000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F426A694000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F426A39A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F426A185000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4269F68000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4269BC0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F426AAA1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4269be1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:38:47.086+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:39:46.222+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] MongoDB starting : pid=1979 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:39:46.229+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:39:46.280+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:39:46.580+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507811986:580385][1979:0x7fbcb3e42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:39:46.580+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:39:46.591+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbcb2d72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBCB2D51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE057000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBCB3A29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBCB3825000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBCB352B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBCB3316000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBCB30F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBCB2D51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBCB3C32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbcb2d72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:39:46.591+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:40:46.718+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] MongoDB starting : pid=2255 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:40:46.725+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:40:46.775+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:40:47.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812047:92895][2255:0x7f84b7a33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:40:47.092+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:40:47.113+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f84b6963635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F84B6942000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84B761A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84B7416000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84B711C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F84B6F07000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84B6CEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F84B6942000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F84B7823000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f84b6963635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:40:47.113+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:41:46.809+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=2498 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:41:46.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:41:46.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:41:47.169+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812107:169182][2498:0x7fd29dec0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:41:47.169+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:41:47.188+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd29cdf0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD29CDCF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD29DAA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD29D8A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD29D5A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD29D394000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD29D177000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD29CDCF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD29DCB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd29cdf0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:41:47.188+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:42:46.322+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=2721 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:42:46.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:42:46.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:42:46.705+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812166:705938][2721:0x7fdf84e95c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:42:46.706+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:42:46.718+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf83dc5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF83DA4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF544D2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF84A7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF84878000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF8457E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF84369000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF8414C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF83DA4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF84C85000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf83dc5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:42:46.718+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:43:46.854+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:43:46.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=2900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:43:46.863+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:43:46.919+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:43:47.219+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812227:219037][2900:0x7f972799ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:43:47.219+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:43:47.230+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f97268ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F97268AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9727585000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9727381000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9727087000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9726E72000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9726C55000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F97268AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F972778E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f97268ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:43:47.230+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:44:46.357+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:44:46.364+0000 I CONTROL [initandlisten] MongoDB starting : pid=3061 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:44:46.364+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:44:46.364+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:44:46.364+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:44:46.365+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:44:46.365+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:44:46.365+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:44:46.365+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:44:46.365+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:44:46.415+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:44:46.682+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812286:682161][3061:0x7f2d1e042c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:44:46.682+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:44:46.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d1cf72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D1CF51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D1DC29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D1DA25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D1D72B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D1D516000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D1D2F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D1CF51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D1DE32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d1cf72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:44:46.692+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:45:46.809+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] MongoDB starting : pid=3201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:45:46.817+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:45:46.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:45:47.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812347:218674][3201:0x7fd160c7cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:45:47.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:45:47.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd15fbac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD15FB8B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C2DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD160863000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD16065F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD160365000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD160150000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD15FF33000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD15FB8B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD160A6C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd15fbac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:45:47.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:46:46.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] MongoDB starting : pid=3491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:46:46.924+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:46:46.976+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:46:47.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812407:377785][3491:0x7f816741dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:46:47.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:46:47.402+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f816634d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F816632C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF582FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8167004000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8166E00000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8166B06000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81668F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F81666D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F816632C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F816720D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f816634d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:46:47.402+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:47:46.522+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] MongoDB starting : pid=3705 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:47:46.529+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:47:46.579+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:47:46.941+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812466:941406][3705:0x7fe708feec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:47:46.941+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:47:46.962+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe707f1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE707EFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1C53000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE708BD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7089D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7086D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7084C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7082A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE707EFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE708DDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe707f1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:47:46.962+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:48:46.078+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] MongoDB starting : pid=3916 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:48:46.086+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:48:46.135+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:48:46.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812526:459229][3916:0x7fde65a17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:48:46.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:48:46.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde64947635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE64926000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66498000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE655FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE653FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE65100000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE64EEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE64CCE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE64926000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE65807000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde64947635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:48:46.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:49:46.591+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] MongoDB starting : pid=4115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:49:46.599+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:49:46.648+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:49:46.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812586:964231][4115:0x7f3ae4173c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:49:46.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:49:46.984+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3ae30a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3AE3082000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E1CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3AE3D5A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3AE3B56000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3AE385C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3AE3647000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3AE342A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3AE3082000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3AE3F63000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3ae30a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:49:46.984+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:50:46.118+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] MongoDB starting : pid=4254 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:50:46.126+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:50:46.175+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:50:46.493+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812646:493928][4254:0x7f5be8b8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:50:46.493+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:50:46.504+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5be7abd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5BE7A9C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF774FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5BE8774000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5BE8570000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5BE8276000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5BE8061000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5BE7E44000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5BE7A9C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5BE897D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5be7abd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:50:46.504+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:51:46.059+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] MongoDB starting : pid=4537 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:51:46.067+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:51:46.119+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:51:46.443+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812706:443454][4537:0x7fdc73871c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:51:46.443+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:51:46.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc727a1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC72780000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA1AE8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC73458000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC73254000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC72F5A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC72D45000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC72B28000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC72780000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC73661000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc727a1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:51:46.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:52:46.580+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] MongoDB starting : pid=4762 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:52:46.588+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:52:46.638+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:52:46.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812766:915467][4762:0x7fb068843c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:52:46.915+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:52:46.926+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb067773635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB067752000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65A0B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB06842A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB068226000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB067F2C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB067D17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB067AFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB067752000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB068633000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb067773635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:52:46.926+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:53:47.056+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] MongoDB starting : pid=5018 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:53:47.064+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:53:47.114+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:53:47.488+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812827:488129][5018:0x7f7fe6089c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:53:47.488+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:53:47.498+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7fe4fb9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7FE4F98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFDAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7FE5C70000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7FE5A6C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7FE5772000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7FE555D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7FE5340000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7FE4F98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7FE5E79000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7fe4fb9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:53:47.498+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:54:47.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] MongoDB starting : pid=5451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:54:47.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:54:47.687+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:54:48.078+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812888:78042][5451:0x7f25392dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:54:48.078+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:54:48.090+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f253820b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25381EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C2FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2538EC2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2538CBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25389C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25387AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2538592000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25381EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25390CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f253820b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:54:48.090+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:55:47.214+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] MongoDB starting : pid=5672 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:55:47.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:55:47.270+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:55:47.548+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507812947:548825][5672:0x7fe46cd90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:55:47.548+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:55:47.559+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe46bcc0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE46BC9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF072FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE46C977000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE46C773000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE46C479000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE46C264000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE46C047000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE46BC9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE46CB80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe46bcc0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:55:47.559+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:56:47.290+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] MongoDB starting : pid=6147 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:56:47.297+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:56:47.348+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:56:47.641+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813007:641955][6147:0x7f5901370c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:56:47.642+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:56:47.652+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59002a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F590027F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84F80000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5900F57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5900D53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5900A59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5900844000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5900627000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F590027F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5901160000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59002a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:56:47.652+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:57:47.772+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] MongoDB starting : pid=6494 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:57:47.779+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:57:47.831+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:57:48.181+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813068:181903][6494:0x7f3aaba66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:57:48.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:57:48.201+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3aaa996635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3AAA975000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3AAB64D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3AAB449000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3AAB14F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3AAAF3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3AAAD1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3AAA975000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3AAB856000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3aaa996635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:57:48.201+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:58:47.318+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] MongoDB starting : pid=6739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:58:47.326+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:58:47.376+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:58:47.647+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813127:647935][6739:0x7fc5046aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:58:47.648+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:58:47.667+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc5035de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC5035BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18A93000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC504295000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC504091000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC503D97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC503B82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC503965000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC5035BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC50449E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc5035de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:58:47.667+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T12:59:47.797+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T12:59:47.804+0000 I CONTROL [initandlisten] MongoDB starting : pid=6942 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T12:59:47.804+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T12:59:47.804+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T12:59:47.804+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T12:59:47.804+0000 I CONTROL [initandlisten] modules: none 2017-10-12T12:59:47.804+0000 I CONTROL [initandlisten] build environment: 2017-10-12T12:59:47.805+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T12:59:47.805+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T12:59:47.805+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T12:59:47.855+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T12:59:48.172+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813188:172785][6942:0x7f2b2073dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T12:59:48.172+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T12:59:48.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b1f66d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B1F64C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF908FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B20324000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B20120000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B1FE26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B1FC11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B1F9F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B1F64C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B2052D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b1f66d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T12:59:48.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:00:47.323+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=7080 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:00:47.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:00:47.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:00:47.718+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813247:718711][7080:0x7f534f2b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:00:47.718+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:00:47.738+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f534e1e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F534E1BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD88C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F534EE97000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F534EC93000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F534E999000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F534E784000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F534E567000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F534E1BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F534F0A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f534e1e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:00:47.738+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:01:47.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=7367 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:01:47.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:01:47.680+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:01:48.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813308:19248][7367:0x7f6996aa5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:01:48.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:01:48.030+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f69959d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F69959B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF942FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F699668C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6996488000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F699618E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6995F79000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6995D5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F69959B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6996895000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f69959d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:01:48.030+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:02:47.856+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] MongoDB starting : pid=7582 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:02:47.863+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:02:47.913+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:02:48.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813368:274872][7582:0x7f1f7e91ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:02:48.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:02:48.294+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f7d84a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F7D829000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7C38000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F7E501000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F7E2FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F7E003000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F7DDEE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F7DBD1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F7D829000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F7E70A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f7d84a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:02:48.294+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:03:47.422+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] MongoDB starting : pid=7791 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:03:47.430+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:03:47.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:03:47.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813427:784319][7791:0x7f22efd41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:03:47.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:03:47.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22eec71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22EEC50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2712A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22EF928000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22EF724000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22EF42A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22EF215000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22EEFF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22EEC50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22EFB31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22eec71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:03:47.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:04:47.927+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] MongoDB starting : pid=7996 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:04:47.935+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:04:47.986+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:04:48.348+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813488:348717][7996:0x7f6171158c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:04:48.348+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:04:48.368+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6170088635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6170067000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3BC4E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6170D3F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6170B3B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6170841000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F617062C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F617040F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6170067000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6170F48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6170088635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:04:48.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:05:47.487+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] MongoDB starting : pid=8132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:05:47.495+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:05:47.545+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:05:47.874+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813547:874937][8132:0x7fc9e6c01c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:05:47.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:05:47.887+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9e5b31635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9E5B10000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9E67E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9E65E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9E62EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9E60D5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9E5EB8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9E5B10000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9E69F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9e5b31635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:05:47.887+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:06:47.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=8420 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:06:47.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:06:47.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:06:48.149+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813608:149397][8420:0x7f417a890c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:06:48.149+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:06:48.160+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41797c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F417979F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F417A477000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F417A273000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4179F79000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4179D64000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4179B47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F417979F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F417A680000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41797c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:06:48.160+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:07:47.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] MongoDB starting : pid=8646 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:07:47.296+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:07:47.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:07:47.691+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813667:691134][8646:0x7ff113152c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:07:47.691+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:07:47.701+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff112082635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF112061000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94C4F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF112D39000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF112B35000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF11283B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF112626000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF112409000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF112061000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF112F42000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff112082635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:07:47.701+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:08:47.833+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] MongoDB starting : pid=8863 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:08:47.840+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:08:47.891+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:08:48.267+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813728:267778][8863:0x7f916ae7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:08:48.267+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:08:48.288+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9169dab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9169D8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70E9F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F916AA62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F916A85E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F916A564000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F916A34F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F916A132000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9169D8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F916AC6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9169dab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:08:48.288+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:09:47.418+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=9064 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:09:47.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:09:47.476+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:09:47.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813787:846382][9064:0x7f16037a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:09:47.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:09:47.869+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16026d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16026B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F160338E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F160318A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1602E90000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1602C7B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1602A5E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16026B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1603597000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16026d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:09:47.869+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:10:48.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=9202 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:10:48.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:10:48.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:10:48.430+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813848:430068][9202:0x7f86e7db7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:10:48.430+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:10:48.450+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86e6ce7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86E6CC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32C18000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86E799E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86E779A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86E74A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86E728B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86E706E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86E6CC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86E7BA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86e6ce7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:10:48.450+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:11:47.399+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:11:47.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=9492 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:11:47.406+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:11:47.406+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:11:47.406+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:11:47.406+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:11:47.407+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:11:47.407+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:11:47.407+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:11:47.407+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:11:47.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:11:47.884+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813907:884180][9492:0x7ffb99011c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:11:47.884+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:11:47.903+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb97f41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB97F20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD7D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB98BF8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB989F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB986FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB984E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB982C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB97F20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB98E01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb97f41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:11:47.903+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:12:48.031+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] MongoDB starting : pid=9714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:12:48.039+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:12:48.088+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:12:48.392+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507813968:392190][9714:0x7f3792565c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:12:48.392+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:12:48.402+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3791495635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3791474000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F379214C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3791F48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3791C4E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3791A39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F379181C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3791474000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3792355000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3791495635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:12:48.402+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:13:47.539+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] MongoDB starting : pid=9930 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:13:47.547+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:13:47.601+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:13:47.944+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814027:944397][9930:0x7f1a7c075c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:13:47.944+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:13:47.954+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a7afa5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A7AF84000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A7BC5C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A7BA58000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A7B75E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A7B549000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A7B32C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A7AF84000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A7BE65000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a7afa5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:13:47.955+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:14:47.078+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] MongoDB starting : pid=10134 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:14:47.086+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:14:47.137+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:14:47.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814087:409299][10134:0x7fda5be52c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:14:47.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:14:47.419+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda5ad82635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA5AD61000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF04EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA5BA39000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA5B835000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA5B53B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA5B326000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA5B109000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA5AD61000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA5BC42000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda5ad82635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:14:47.419+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:15:47.549+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:15:47.556+0000 I CONTROL [initandlisten] MongoDB starting : pid=10272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:15:47.557+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:15:47.606+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:15:47.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814147:911111][10272:0x7f3fb25a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:15:47.911+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:15:47.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3fb14d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3FB14B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3FB2189000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3FB1F85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3FB1C8B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3FB1A76000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3FB1859000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3FB14B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3FB2392000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3fb14d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:15:47.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:16:47.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=10563 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:16:47.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:16:47.959+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:16:48.284+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814208:284037][10563:0x7f0e279abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:16:48.284+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:16:48.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e268db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E268BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0ACE0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E27592000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E2738E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E27094000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E26E7F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E26C62000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E268BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E2779B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e268db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:16:48.297+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:17:47.429+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] MongoDB starting : pid=10780 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:17:47.436+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:17:47.486+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:17:47.822+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814267:822174][10780:0x7f04dd8aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:17:47.822+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:17:47.832+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04dc7de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04DC7BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04DD495000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04DD291000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04DCF97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04DCD82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04DCB65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04DC7BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04DD69E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04dc7de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:17:47.832+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:18:47.962+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=10987 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:18:47.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:18:48.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:18:48.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814328:338835][10987:0x7f389133bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:18:48.338+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:18:48.349+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f389026b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F389024A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95A01000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3890F22000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3890D1E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3890A24000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F389080F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38905F2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F389024A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F389112B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f389026b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:18:48.349+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:19:47.471+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] MongoDB starting : pid=11167 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:19:47.476+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:19:47.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:19:47.755+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814387:755501][11167:0x7f84dcdeec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:19:47.755+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:19:47.767+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f84dbd1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F84DBCFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84DC9D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84DC7D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84DC4D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F84DC2C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84DC0A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F84DBCFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F84DCBDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f84dbd1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:19:47.767+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:20:47.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=11325 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:20:47.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:20:47.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:20:48.227+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814448:227238][11325:0x7f8e9dd13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:20:48.227+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:20:48.246+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e9cc43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E9CC22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98C5F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E9D8FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E9D6F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E9D3FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E9D1E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E9CFCA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E9CC22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E9DB03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e9cc43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:20:48.246+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:21:48.012+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] MongoDB starting : pid=11473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:21:48.020+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:21:48.070+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:21:48.386+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814508:386627][11473:0x7fe5025e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:21:48.386+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:21:48.398+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe501515635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5014F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DCAF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE5021CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE501FC8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE501CCE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE501AB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE50189C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5014F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE5023D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe501515635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:21:48.398+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:22:47.514+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=11742 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:22:47.522+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:22:47.572+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:22:47.822+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814567:822049][11742:0x7fbc6cc50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:22:47.822+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:22:47.833+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc6bb80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC6BB5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF0AD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC6C837000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC6C633000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC6C339000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC6C124000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC6BF07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC6BB5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC6CA40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc6bb80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:22:47.833+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:23:47.951+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=11950 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:23:47.958+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:23:47.959+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:23:48.009+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:23:48.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814628:315208][11950:0x7f12d7219c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:23:48.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:23:48.326+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12d6149635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12D6128000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70607000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12D6E00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12D6BFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12D6902000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F12D66ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F12D64D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12D6128000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12D7009000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12d6149635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:23:48.326+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:24:47.446+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] MongoDB starting : pid=12154 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:24:47.454+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:24:47.503+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:24:47.791+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814687:791840][12154:0x7f0fdb7e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:24:47.791+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:24:47.802+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fda714635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FDA6F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF45D49000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FDB3CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FDB1C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FDAECD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FDACB8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FDAA9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FDA6F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FDB5D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fda714635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:24:47.802+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:25:47.926+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] MongoDB starting : pid=12374 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:25:47.933+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:25:47.982+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:25:48.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814748:276349][12374:0x7fa715bd8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:25:48.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:25:48.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa714b08635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA714AE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7157BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7155BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7152C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7150AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA714E8F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA714AE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7159C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa714b08635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:25:48.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:26:47.215+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] MongoDB starting : pid=12533 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:26:47.223+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:26:47.273+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:26:47.552+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814807:552344][12533:0x7f774d5d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:26:47.552+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:26:47.562+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f774c508635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F774C4E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF9B89000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F774D1BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F774CFBB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F774CCC1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F774CAAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F774C88F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F774C4E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F774D3C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f774c508635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:26:47.562+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:27:47.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=12799 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:27:47.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:27:47.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:27:48.061+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814868:61538][12799:0x7f7e6e5bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:27:48.061+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:27:48.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e6d4ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E6D4CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9248B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E6E1A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E6DFA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E6DCA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E6DA92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E6D875000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E6D4CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E6E3AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e6d4ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:27:48.081+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:28:47.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=13018 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:28:47.217+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:28:47.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:28:47.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:28:47.550+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814927:550291][13018:0x7f99d66bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:28:47.550+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:28:47.560+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99d55ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99D55CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0A5CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99D62A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99D609F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99D5DA5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99D5B90000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99D5973000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99D55CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99D64AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99d55ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:28:47.560+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:29:47.683+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:29:47.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=13217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:29:47.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:29:47.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:29:47.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:29:47.690+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:29:47.691+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:29:47.691+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:29:47.691+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:29:47.691+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:29:47.740+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:29:48.095+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507814988:95415][13217:0x7fb15026bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:29:48.095+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:29:48.106+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb14f19b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB14F17A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB14FE52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB14FC4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB14F954000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB14F73F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB14F522000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB14F17A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB15005B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb14f19b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:29:48.106+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:30:47.240+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] MongoDB starting : pid=13442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:30:47.248+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:30:47.299+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:30:47.621+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815047:621056][13442:0x7fd4d4fa9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:30:47.621+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:30:47.643+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4d3ed9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4D3EB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0EDC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD4D4B90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD4D498C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD4D4692000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD4D447D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD4D4260000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4D3EB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4D4D99000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4d3ed9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:30:47.643+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:31:47.327+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] MongoDB starting : pid=13592 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:31:47.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:31:47.384+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:31:47.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815107:670414][13592:0x7fa128f26c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:31:47.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:31:47.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa127e56635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA127E35000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF628FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA128B0D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA128909000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA12860F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1283FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1281DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA127E35000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA128D16000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa127e56635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:31:47.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:32:47.819+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=13856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:32:47.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:32:47.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:32:48.210+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815168:210647][13856:0x7f9ab6ccac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:32:48.210+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:32:48.221+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ab5bfa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9AB5BD9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90D9F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9AB68B1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9AB66AD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9AB63B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9AB619E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9AB5F81000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9AB5BD9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9AB6ABA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ab5bfa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:32:48.221+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:33:47.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=14065 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:33:47.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:33:47.393+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:33:47.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815227:724602][14065:0x7f23db8dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:33:47.724+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:33:47.744+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f23da80f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F23DA7EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBDCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F23DB4C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F23DB2C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F23DAFC8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F23DADB3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F23DAB96000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F23DA7EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F23DB6CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f23da80f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:33:47.744+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:34:47.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] MongoDB starting : pid=14274 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:34:47.871+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:34:47.923+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:34:48.294+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815288:294263][14274:0x7f359f1acc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:34:48.294+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:34:48.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f359e0dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F359E0BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC21E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F359ED93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F359EB8F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F359E895000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F359E680000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F359E463000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F359E0BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F359EF9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f359e0dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:34:48.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:35:47.448+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] MongoDB starting : pid=14788 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:35:47.456+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:35:47.508+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:35:47.870+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815347:870406][14788:0x7f7ddf8d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:35:47.870+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:35:47.881+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dde807635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DDE7E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF948FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DDF4BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DDF2BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DDEFC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DDEDAB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DDEB8E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DDE7E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DDF6C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dde807635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:35:47.881+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:36:47.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] MongoDB starting : pid=15008 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:36:47.663+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:36:47.714+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:36:48.020+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815408:20831][15008:0x7f91d0ea5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:36:48.020+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:36:48.032+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91cfdd5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91CFDB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F91D0A8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F91D0888000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F91D058E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F91D0379000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F91D015C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91CFDB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91D0C95000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91cfdd5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:36:48.032+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:37:47.163+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] MongoDB starting : pid=15269 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:37:47.171+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:37:47.220+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:37:47.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815467:490599][15269:0x7fb0ebaa7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:37:47.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:37:47.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0ea9d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0EA9B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1EE1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0EB68E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0EB48A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0EB190000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0EAF7B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0EAD5E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0EA9B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0EB897000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0ea9d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:37:47.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:38:47.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] MongoDB starting : pid=15490 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:38:47.627+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:38:47.686+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:38:48.067+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815528:67907][15490:0x7fd554b24c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:38:48.068+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:38:48.087+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd553a54635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD553A33000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE1CF7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD55470B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD554507000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD55420D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD553FF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD553DDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD553A33000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD554914000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd553a54635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:38:48.087+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:39:47.218+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] MongoDB starting : pid=15691 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:39:47.225+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:39:47.226+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:39:47.276+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:39:47.571+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815587:571919][15691:0x7f906c8f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:39:47.571+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:39:47.582+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f906b829635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F906B808000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54C00000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F906C4E0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F906C2DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F906BFE2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F906BDCD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F906BBB0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F906B808000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F906C6E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f906b829635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:39:47.582+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:40:47.704+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] MongoDB starting : pid=15913 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:40:47.712+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:40:47.761+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:40:48.053+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815648:53064][15913:0x7f7486186c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:40:48.053+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:40:48.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74850b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7485095000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF252F0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7485D6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7485B69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F748586F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F748565A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F748543D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7485095000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7485F76000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74850b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:40:48.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:41:47.482+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] MongoDB starting : pid=16071 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:41:47.489+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:41:47.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:41:47.871+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815707:871420][16071:0x7fb51cf60c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:41:47.871+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:41:47.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb51be90635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB51BE6F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB51CB47000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB51C943000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB51C649000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB51C434000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB51C217000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB51BE6F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB51CD50000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb51be90635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:41:47.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:42:48.014+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] MongoDB starting : pid=16329 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:42:48.022+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:42:48.071+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:42:48.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815768:409293][16329:0x7feb7d99dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:42:48.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:42:48.429+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb7c8cd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB7C8AC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3738D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB7D584000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB7D380000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB7D086000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB7CE71000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB7CC54000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB7C8AC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB7D78D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb7c8cd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:42:48.429+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:43:47.555+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:43:47.562+0000 I CONTROL [initandlisten] MongoDB starting : pid=16557 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:43:47.563+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:43:47.614+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:43:47.924+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815827:924613][16557:0x7f20be75dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:43:47.924+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:43:47.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f20bd68d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F20BD66C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA1403000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F20BE344000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F20BE140000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20BDE46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F20BDC31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F20BDA14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F20BD66C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F20BE54D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f20bd68d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:43:47.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:44:47.057+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=16759 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:44:47.065+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:44:47.115+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:44:47.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815887:377893][16759:0x7f041ccfac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:44:47.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:44:47.388+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f041bc2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F041BC09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F041C8E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F041C6DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F041C3E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F041C1CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F041BFB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F041BC09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F041CAEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f041bc2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:44:47.388+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:45:47.517+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=16980 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:45:47.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:45:47.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:45:47.920+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507815947:920906][16980:0x7f7cd57a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:45:47.920+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:45:47.940+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7cd46d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CD46AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CD5387000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CD5183000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CD4E89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CD4C74000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CD4A57000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CD46AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CD5590000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7cd46d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:45:47.940+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:46:47.343+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] MongoDB starting : pid=17130 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:46:47.353+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:46:47.406+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:46:47.760+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816007:760367][17130:0x7fd4993bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:46:47.760+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:46:47.780+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4982ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4982C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE605E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD498FA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD498D9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD498AA3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD49888E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD498671000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4982C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4991AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4982ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:46:47.780+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:47:47.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:47:47.245+0000 I CONTROL [initandlisten] MongoDB starting : pid=17392 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:47:47.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:47:47.295+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:47:47.576+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816067:576155][17392:0x7f3d03b94c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:47:47.576+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:47:47.586+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d02ac4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D02AA3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5EB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D0377B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D03577000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D0327D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D03068000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D02E4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D02AA3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D03984000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d02ac4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:47:47.586+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:48:47.719+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:48:47.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=17616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:48:47.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:48:47.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:48:47.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:48:47.727+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:48:47.727+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:48:47.727+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:48:47.727+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:48:47.727+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:48:47.778+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:48:48.167+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816128:167755][17616:0x7f3de21bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:48:48.167+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:48:48.186+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3de10ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DE10CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DE1DA4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DE1BA0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DE18A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DE1691000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DE1474000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DE10CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DE1FAD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3de10ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:48:48.187+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:49:47.314+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] MongoDB starting : pid=17815 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:49:47.322+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:49:47.372+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:49:47.735+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816187:735608][17815:0x7fbae288bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:49:47.735+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:49:47.755+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbae17bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAE179A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB00FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAE2472000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAE226E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAE1F74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAE1D5F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAE1B42000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAE179A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAE267B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbae17bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:49:47.755+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:50:47.876+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] MongoDB starting : pid=18037 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:50:47.885+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:50:47.935+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:50:48.277+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816248:277750][18037:0x7f9973ecbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:50:48.277+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:50:48.297+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9972dfb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9972DDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9973AB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99738AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99735B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F997339F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9973182000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9972DDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9973CBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9972dfb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:50:48.297+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:51:47.721+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] MongoDB starting : pid=18185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:51:47.728+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:51:47.778+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:51:48.140+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816308:140381][18185:0x7fbb1c3e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:51:48.140+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:51:48.160+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb1b310635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB1B2EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12499000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB1BFC7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB1BDC3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB1BAC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB1B8B4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB1B697000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB1B2EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB1C1D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb1b310635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:51:48.160+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:52:47.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=18436 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:52:47.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:52:47.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:52:47.822+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816367:822456][18436:0x7feffc44ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:52:47.822+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:52:47.832+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feffb37a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFFB359000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA40B2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFFC031000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFFBE2D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFFBB33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFFB91E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFFB701000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFFB359000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFFC23A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feffb37a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:52:47.833+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:53:47.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:53:47.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=18658 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:53:47.971+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:53:48.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:53:48.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816428:315889][18658:0x7fad16000c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:53:48.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:53:48.326+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fad14f30635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAD14F0F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C20C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAD15BE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAD159E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAD156E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAD154D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAD152B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAD14F0F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAD15DF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fad14f30635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:53:48.326+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:54:47.446+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] MongoDB starting : pid=18845 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:54:47.454+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:54:47.503+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:54:47.829+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816487:829062][18845:0x7fb591cf1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:54:47.829+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:54:47.840+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb590c21635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB590C00000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB5918D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB5916D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB5913DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB5911C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB590FA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB590C00000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB591AE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb590c21635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:54:47.840+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:55:47.968+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] MongoDB starting : pid=18990 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:55:47.976+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:55:48.026+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:55:48.351+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816548:351221][18990:0x7f6fff9c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:55:48.351+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:55:48.370+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6ffe8f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6FFE8D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF666FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6FFF5AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6FFF3A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6FFF0AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6FFEE97000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6FFEC7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6FFE8D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6FFF7B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6ffe8f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:55:48.370+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:56:47.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] MongoDB starting : pid=19219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:56:47.835+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:56:47.893+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:56:48.148+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816608:148577][19219:0x7f5a3ea81c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:56:48.148+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:56:48.159+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a3d9b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A3D990000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A3E668000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A3E464000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A3E16A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A3DF55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A3DD38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A3D990000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A3E871000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a3d9b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:56:48.159+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:57:47.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] MongoDB starting : pid=19337 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:57:47.795+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:57:47.845+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:57:48.175+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816668:175135][19337:0x7f4b329e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:57:48.175+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:57:48.187+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b31913635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B318F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A2A1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B325CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B323C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B320CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B31EB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B31C9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B318F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B327D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b31913635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:57:48.187+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:58:47.320+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] MongoDB starting : pid=19613 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:58:47.328+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:58:47.380+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:58:47.685+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816727:685929][19613:0x7fd801750c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:58:47.685+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:58:47.698+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd800680635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD80065F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF84FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD801337000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD801133000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD800E39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD800C24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD800A07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD80065F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD801540000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd800680635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:58:47.698+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T13:59:47.837+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] MongoDB starting : pid=19812 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] modules: none 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] build environment: 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T13:59:47.845+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T13:59:47.894+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T13:59:48.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816788:266816][19812:0x7f2febfecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T13:59:48.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T13:59:48.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2feaf1c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FEAEFB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FEBBD3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FEB9CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FEB6D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FEB4C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FEB2A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FEAEFB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FEBDDC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2feaf1c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T13:59:48.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:00:47.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] MongoDB starting : pid=20047 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:00:47.420+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:00:47.472+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:00:47.838+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816847:838552][20047:0x7f250b574c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:00:47.838+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:00:47.858+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f250a4a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F250A483000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F250B15B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F250AF57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F250AC5D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F250AA48000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F250A82B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F250A483000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F250B364000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f250a4a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:00:47.858+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:01:47.310+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] MongoDB starting : pid=20270 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:01:47.321+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:01:47.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:01:47.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816907:751567][20270:0x7ff3d5351c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:01:47.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:01:47.773+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3d4281635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3D4260000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA94FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3D4F38000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3D4D34000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3D4A3A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3D4825000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3D4608000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3D4260000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3D5141000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3d4281635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:01:47.773+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:02:47.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=20401 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:02:47.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:02:47.288+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:02:47.646+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507816967:646019][20401:0x7f15a474fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:02:47.646+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:02:47.666+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15a367f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15A365E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15A4336000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15A4132000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15A3E38000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15A3C23000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15A3A06000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15A365E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15A453F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15a367f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:02:47.666+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:03:47.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=20672 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:03:47.798+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:03:47.861+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:03:48.157+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817028:157433][20672:0x7f7929ea1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:03:48.157+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:03:48.177+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7928dd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7928DB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7929A88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7929884000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F792958A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7929375000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7929158000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7928DB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7929C91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7928dd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:03:48.177+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:04:47.294+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] MongoDB starting : pid=20876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:04:47.302+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:04:47.352+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:04:47.727+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817087:727151][20876:0x7f7f1c0d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:04:47.727+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:04:47.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f1b008635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F1AFE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F1BCBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F1BABB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F1B7C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F1B5AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F1B38F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F1AFE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F1BEC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f1b008635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:04:47.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:05:47.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] MongoDB starting : pid=21129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:05:47.883+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:05:47.933+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:05:48.229+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817148:229273][21129:0x7f00ef1e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:05:48.229+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:05:48.239+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00ee116635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00EE0F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF27AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00EEDCD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00EEBC9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00EE8CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00EE6BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00EE49D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00EE0F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00EEFD6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00ee116635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:05:48.239+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:06:47.627+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] MongoDB starting : pid=21345 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:06:47.634+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:06:47.685+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:06:48.042+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817208:42696][21345:0x7f724acaec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:06:48.042+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:06:48.062+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7249bde635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7249BBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F724A895000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F724A691000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F724A397000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F724A182000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7249F65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7249BBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F724AA9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7249bde635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:06:48.062+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:07:47.083+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] MongoDB starting : pid=21480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:07:47.091+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:07:47.140+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:07:47.424+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817267:424718][21480:0x7f3722570c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:07:47.424+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:07:47.445+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37214a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F372147F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3722157000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3721F53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3721C59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3721A44000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3721827000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F372147F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3722360000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37214a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:07:47.445+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:08:47.554+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] MongoDB starting : pid=21753 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:08:47.559+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:08:47.603+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:08:47.879+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817327:879949][21753:0x7faf033dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:08:47.880+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:08:47.890+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf0230b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF022EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF692FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF02FC2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF02DBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF02AC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF028AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF02692000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF022EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF031CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf0230b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:08:47.890+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:09:48.014+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:09:48.022+0000 I CONTROL [initandlisten] MongoDB starting : pid=21956 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:09:48.023+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:09:48.075+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:09:48.467+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817388:466986][21956:0x7f7c22a18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:09:48.467+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:09:48.486+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c21948635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C21927000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1477000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C225FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C223FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C22101000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C21EEC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C21CCF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C21927000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C22808000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c21948635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:09:48.486+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:10:47.610+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] MongoDB starting : pid=22180 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:10:47.618+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:10:47.619+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:10:47.670+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:10:48.030+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817448:30252][22180:0x7f28e80a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:10:48.030+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:10:48.040+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28e6fd0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28E6FAF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC7061000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28E7C87000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28E7A83000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28E7789000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F28E7574000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28E7357000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28E6FAF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28E7E90000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28e6fd0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:10:48.041+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:11:47.436+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] MongoDB starting : pid=22392 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:11:47.445+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:11:47.497+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:11:47.770+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817507:769970][22392:0x7f4fff582c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:11:47.770+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:11:47.780+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ffe4b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4FFE491000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E48B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4FFF169000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4FFEF65000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4FFEC6B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4FFEA56000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4FFE839000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4FFE491000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4FFF372000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ffe4b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:11:47.780+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:12:47.319+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:12:47.327+0000 I CONTROL [initandlisten] MongoDB starting : pid=22606 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:12:47.328+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:12:47.378+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:12:47.710+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817567:710385][22606:0x7f2e62274c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:12:47.710+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:12:47.730+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e611a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E61183000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E61E5B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E61C57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E6195D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E61748000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E6152B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E61183000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E62064000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e611a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:12:47.730+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:13:47.851+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] MongoDB starting : pid=22927 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:13:47.858+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:13:47.909+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:13:48.185+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817628:185770][22927:0x7f8be4a2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:13:48.185+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:13:48.196+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8be395b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BE393A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF286FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BE4612000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BE440E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BE4114000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BE3EFF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BE3CE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BE393A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BE481B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8be395b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:13:48.196+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:14:47.313+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] MongoDB starting : pid=23132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:14:47.321+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:14:47.371+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:14:47.624+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817687:624923][23132:0x7fcd29e67c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:14:47.624+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:14:47.635+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd28d97635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD28D76000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7233000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD29A4E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD2984A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD29550000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD2933B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD2911E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD28D76000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD29C57000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd28d97635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:14:47.635+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:15:47.768+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] MongoDB starting : pid=23354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:15:47.776+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:15:47.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:15:48.166+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817748:166767][23354:0x7f2fe87afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:15:48.166+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:15:48.177+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2fe76df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FE76BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FE8396000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FE8192000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FE7E98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FE7C83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FE7A66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FE76BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FE859F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2fe76df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:15:48.177+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:16:47.638+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] MongoDB starting : pid=23564 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:16:47.646+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:16:47.698+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:16:48.034+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817808:34396][23564:0x7f1c70881c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:16:48.034+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:16:48.044+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1c6f7b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1C6F790000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF69AA2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1C70468000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1C70264000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1C6FF6A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1C6FD55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1C6FB38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1C6F790000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1C70671000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1c6f7b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:16:48.044+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:17:47.835+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] MongoDB starting : pid=23711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:17:47.843+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:17:47.893+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:17:48.225+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817868:225132][23711:0x7f5d2162ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:17:48.225+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:17:48.244+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d2055e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D2053D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF140DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D21215000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D21011000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D20D17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D20B02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D208E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D2053D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D2141E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d2055e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:17:48.244+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:18:47.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] MongoDB starting : pid=23991 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:18:47.383+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:18:47.432+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:18:47.755+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817927:755760][23991:0x7fa99a593c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:18:47.755+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:18:47.775+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9994c3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9994A2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF469C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA99A17A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA999F76000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA999C7C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA999A67000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA99984A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9994A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA99A383000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9994c3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:18:47.776+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:19:47.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=24191 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:19:47.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:19:47.972+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:19:48.362+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507817988:362375][24191:0x7f760d13fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:19:48.362+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:19:48.381+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f760c06f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F760C04E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF594D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F760CD26000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F760CB22000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F760C828000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F760C613000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F760C3F6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F760C04E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F760CF2F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f760c06f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:19:48.381+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:20:47.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] MongoDB starting : pid=24411 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:20:47.496+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:20:47.533+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:20:47.794+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818047:794030][24411:0x7fee17b02c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:20:47.794+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:20:47.804+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee16a32635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE16A11000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D8E2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE176E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE174E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE171EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE16FD6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE16DB9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE16A11000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE178F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee16a32635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:20:47.804+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:21:47.191+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] MongoDB starting : pid=24616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:21:47.199+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:21:47.248+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:21:47.613+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818107:613388][24616:0x7f005f7e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:21:47.613+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:21:47.624+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f005e710635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F005E6EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40418000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F005F3C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F005F1C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F005EEC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F005ECB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F005EA97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F005E6EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F005F5D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f005e710635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:21:47.624+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:22:47.251+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:22:47.260+0000 I CONTROL [initandlisten] MongoDB starting : pid=24770 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:22:47.260+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:22:47.260+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:22:47.260+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:22:47.260+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:22:47.260+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:22:47.261+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:22:47.261+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:22:47.261+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:22:47.311+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:22:47.614+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818167:614455][24770:0x7f6fc96a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:22:47.614+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:22:47.625+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6fc85d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6FC85B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6FC928A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6FC9086000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6FC8D8C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6FC8B77000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6FC895A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6FC85B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6FC9493000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6fc85d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:22:47.625+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:23:47.747+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] MongoDB starting : pid=25041 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:23:47.755+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:23:47.807+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:23:48.114+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818228:114723][25041:0x7f385ae95c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:23:48.114+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:23:48.134+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3859dc5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3859DA4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2AD3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F385AA7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F385A878000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F385A57E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F385A369000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F385A14C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3859DA4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F385AC85000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3859dc5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:23:48.134+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:24:47.266+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=25253 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:24:47.274+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:24:47.328+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:24:47.665+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818287:665368][25253:0x7f45a09a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:24:47.665+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:24:47.677+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f459f8d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F459F8B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45A058A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45A0386000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45A008C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F459FE77000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F459FC5A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F459F8B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45A0793000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f459f8d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:24:47.677+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:25:47.798+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=25484 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:25:47.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:25:47.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:25:48.207+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818348:207271][25484:0x7f5ad16c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:25:48.207+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:25:48.226+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ad05f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AD05D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0979000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AD12B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AD10AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AD0DB2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AD0B9D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AD0980000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AD05D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AD14B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ad05f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:25:48.226+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:26:47.694+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] MongoDB starting : pid=25704 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:26:47.702+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:26:47.752+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:26:48.031+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818408:31679][25704:0x7fdada11fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:26:48.031+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:26:48.042+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdad904f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDAD902E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF564FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDAD9D06000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDAD9B02000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDAD9808000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDAD95F3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDAD93D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDAD902E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDAD9F0F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdad904f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:26:48.042+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:27:47.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:27:47.713+0000 I CONTROL [initandlisten] MongoDB starting : pid=25847 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:27:47.713+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:27:47.713+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:27:47.713+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:27:47.714+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:27:47.714+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:27:47.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:27:47.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:27:47.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:27:47.771+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:27:48.104+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818468:104306][25847:0x7fbad6d68c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:27:48.104+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:27:48.115+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbad5c98635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAD5C77000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF984FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAD694F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAD674B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAD6451000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAD623C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAD601F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAD5C77000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAD6B58000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbad5c98635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:27:48.115+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:28:47.243+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=26129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:28:47.251+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:28:47.302+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:28:47.654+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818527:654051][26129:0x7f59d58b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:28:47.654+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:28:47.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59d47e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59D47C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82CE8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59D5499000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59D5295000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59D4F9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59D4D86000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59D4B69000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59D47C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59D56A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59d47e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:28:47.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:29:47.814+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] MongoDB starting : pid=26331 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:29:47.821+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:29:47.871+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:29:48.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818588:158949][26331:0x7f035e642c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:29:48.159+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:29:48.169+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f035d572635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F035D551000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF25DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F035E229000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F035E025000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F035DD2B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F035DB16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F035D8F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F035D551000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F035E432000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f035d572635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:29:48.169+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:30:47.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] MongoDB starting : pid=26454 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:30:47.295+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:30:47.345+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:30:47.612+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818647:612149][26454:0x7fb74f5afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:30:47.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:30:47.623+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb74e4df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB74E4BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F639000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB74F196000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB74EF92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB74EC98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB74EA83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB74E866000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB74E4BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB74F39F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb74e4df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:30:47.623+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:31:48.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=26663 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:31:48.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:31:48.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:31:48.385+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818708:385562][26663:0x7fccfbfa7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:31:48.385+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:31:48.396+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fccfaed7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCFAEB6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B4F7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCFBB8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCFB98A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCFB690000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCFB47B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCFB25E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCFAEB6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCFBD97000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fccfaed7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:31:48.396+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:32:47.904+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] MongoDB starting : pid=26892 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:32:47.911+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:32:47.962+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:32:48.312+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818768:312141][26892:0x7f22dcc78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:32:48.312+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:32:48.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22dbba8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22DBB87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF294E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22DC85F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22DC65B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22DC361000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22DC14C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22DBF2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22DBB87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22DCA68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22dbba8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:32:48.322+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:33:47.456+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] MongoDB starting : pid=27024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:33:47.464+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:33:47.515+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:33:47.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818827:837712][27024:0x7f3f3abebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:33:47.837+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:33:47.848+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f39b1b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F39AFA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF187C9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F3A7D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F3A5CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F3A2D4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F3A0BF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F39EA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F39AFA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F3A9DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f39b1b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:33:47.848+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:34:47.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=27289 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:34:47.979+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:34:48.030+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:34:48.357+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818888:357369][27289:0x7fdf4b0d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:34:48.357+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:34:48.369+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdf4a008635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDF49FE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF0EFD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDF4ACBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDF4AABB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDF4A7C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDF4A5AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDF4A38F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDF49FE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDF4AEC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdf4a008635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:34:48.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:35:47.494+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] MongoDB starting : pid=27509 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:35:47.502+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:35:47.552+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:35:47.799+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507818947:799355][27509:0x7f9d56156c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:35:47.799+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:35:47.809+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d55086635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D55065000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D55D3D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D55B39000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D5583F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D5562A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D5540D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D55065000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D55F46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d55086635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:35:47.809+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:36:47.262+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] MongoDB starting : pid=27726 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:36:47.270+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:36:47.320+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:36:47.641+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819007:641799][27726:0x7f4669341c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:36:47.641+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:36:47.652+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4668271635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4668250000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9EC16000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4668F28000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4668D24000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4668A2A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4668815000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F46685F8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4668250000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4669131000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4668271635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:36:47.652+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:37:47.354+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:37:47.362+0000 I CONTROL [initandlisten] MongoDB starting : pid=27956 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:37:47.362+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:37:47.362+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:37:47.362+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:37:47.363+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:37:47.363+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:37:47.363+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:37:47.363+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:37:47.363+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:37:47.414+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:37:47.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819067:775720][27956:0x7fbc483c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:37:47.775+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:37:47.795+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc472f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC472D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDACFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC47FB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC47DAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC47AB2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC4789D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC47680000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC472D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC481B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc472f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:37:47.795+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:38:47.924+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:38:47.931+0000 I CONTROL [initandlisten] MongoDB starting : pid=28100 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:38:47.931+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:38:47.931+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:38:47.931+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:38:47.931+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:38:47.931+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:38:47.932+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:38:47.932+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:38:47.932+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:38:47.982+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:38:48.321+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819128:321648][28100:0x7f1d1ddb2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:38:48.321+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:38:48.332+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d1cce2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D1CCC1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D1D999000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D1D795000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D1D49B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D1D286000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D1D069000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D1CCC1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D1DBA2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d1cce2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:38:48.332+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:39:47.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=28364 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:39:47.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:39:47.512+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:39:47.857+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819187:857568][28364:0x7f28f62f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:39:47.857+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:39:47.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28f5229635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28F5208000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28F5EE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28F5CDC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28F59E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F28F57CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28F55B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28F5208000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28F60E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28f5229635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:39:47.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:40:47.998+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:40:48.006+0000 I CONTROL [initandlisten] MongoDB starting : pid=28569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:40:48.007+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:40:48.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:40:48.357+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819248:357407][28569:0x7fab8256fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:40:48.357+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:40:48.377+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fab8149f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAB8147E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAB82156000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB81F52000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB81C58000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB81A43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB81826000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB8147E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB8235F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fab8149f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:40:48.377+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:41:47.855+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=28812 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:41:47.862+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:41:47.863+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:41:47.915+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:41:48.247+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819308:247361][28812:0x7f2bf3e30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:41:48.247+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:41:48.260+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2bf2d60635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2BF2D3F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2BF3A17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2BF3813000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2BF3519000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2BF3304000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2BF30E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2BF2D3F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2BF3C20000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2bf2d60635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:41:48.261+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:42:47.654+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] MongoDB starting : pid=29051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:42:47.661+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:42:47.713+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:42:48.012+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819368:12517][29051:0x7f5e6958ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:42:48.012+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:42:48.023+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e684ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E68499000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF224FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E69171000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E68F6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E68C73000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E68A5E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E68841000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E68499000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E6937A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e684ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:42:48.023+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:43:47.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=29207 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:43:47.158+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:43:47.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:43:47.516+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819427:516500][29207:0x7f4ec1f11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:43:47.516+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:43:47.528+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ec0e41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4EC0E20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC7A13000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4EC1AF8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4EC18F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4EC15FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4EC13E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4EC11C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4EC0E20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4EC1D01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ec0e41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:43:47.528+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:44:47.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] MongoDB starting : pid=29465 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:44:47.663+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:44:47.714+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:44:47.984+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819487:984573][29465:0x7fdbe6643c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:44:47.984+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:44:47.995+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdbe5573635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDBE5552000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF188FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDBE622A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDBE6026000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDBE5D2C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDBE5B17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDBE58FA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDBE5552000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDBE6433000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdbe5573635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:44:47.995+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:45:47.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] MongoDB starting : pid=29662 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:45:47.122+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:45:47.171+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:45:47.428+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819547:428168][29662:0x7f3e4a54fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:45:47.428+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:45:47.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e4947f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E4945E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE179D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E4A136000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E49F32000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E49C38000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E49A23000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E49806000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E4945E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E4A33F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e4947f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:45:47.439+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:46:47.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=29890 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:46:47.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:46:47.884+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:46:48.252+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819608:252959][29890:0x7f831409dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:46:48.253+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:46:48.272+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8312fcd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8312FAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99FDE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8313C84000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8313A80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8313786000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8313571000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8313354000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8312FAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8313E8D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8312fcd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:46:48.272+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:47:47.131+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] MongoDB starting : pid=30118 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:47:47.139+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:47:47.190+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:47:47.540+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819667:540245][30118:0x7f7b7c7ddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:47:47.540+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:47:47.550+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7b7b70d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7B7B6EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF024FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7B7C3C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7B7C1C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7B7BEC6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7B7BCB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7B7BA94000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7B7B6EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7B7C5CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7b7b70d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:47:47.550+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:48:47.685+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] MongoDB starting : pid=30257 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:48:47.692+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:48:47.742+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:48:48.025+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819728:25687][30257:0x7f078bcb7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:48:48.025+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:48:48.036+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f078abe7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F078ABC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000002FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F078B89E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F078B69A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F078B3A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F078B18B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F078AF6E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F078ABC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F078BAA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f078abe7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:48:48.036+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:49:47.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] MongoDB starting : pid=30507 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:49:47.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:49:47.210+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:49:47.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819787:463831][30507:0x7fc150ac2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:49:47.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:49:47.484+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc14f9f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC14F9D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49458000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC1506A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC1504A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC1501AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC14FF96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC14FD79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC14F9D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1508B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc14f9f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:49:47.484+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:50:47.601+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] MongoDB starting : pid=30708 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:50:47.609+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:50:47.660+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:50:47.952+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819847:952956][30708:0x7fb051c11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:50:47.953+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:50:47.963+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb050b41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB050B20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF134FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0517F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0515F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0512FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0510E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB050EC8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB050B20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB051A01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb050b41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:50:47.963+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:51:47.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] MongoDB starting : pid=30942 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:51:47.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:51:47.409+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:51:47.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819907:696952][30942:0x7f7d88877c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:51:47.697+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:51:47.707+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d877a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D87786000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B222000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D8845E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D8825A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D87F60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D87D4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D87B2E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D87786000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D88667000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d877a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:51:47.707+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:52:47.303+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] MongoDB starting : pid=31170 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:52:47.311+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:52:47.360+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:52:47.732+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507819967:731996][31170:0x7f140b562c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:52:47.732+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:52:47.751+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f140a492635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F140A471000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE48FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F140B149000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F140AF45000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F140AC4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F140AA36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F140A819000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F140A471000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F140B352000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f140a492635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:52:47.751+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:53:47.871+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] MongoDB starting : pid=31308 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:53:47.879+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:53:47.930+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:53:48.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820028:243549][31308:0x7f8864b31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:53:48.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:53:48.254+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8863a61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8863A40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF252FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8864718000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8864514000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F886421A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8864005000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8863DE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8863A40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8864921000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8863a61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:53:48.254+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:54:47.384+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=31562 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:54:47.392+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:54:47.443+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:54:47.804+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820087:804484][31562:0x7f7118bf6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:54:47.804+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:54:47.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7117b26635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7117B05000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEEAD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F71187DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71185D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71182DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71180CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7117EAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7117B05000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F71189E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7117b26635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:54:47.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:55:47.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] MongoDB starting : pid=31767 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:55:47.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:55:48.005+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:55:48.395+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820148:394984][31767:0x7f01c829fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:55:48.395+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:55:48.414+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f01c71cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F01C71AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF77EDF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01C7E86000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01C7C82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01C7988000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01C7773000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01C7556000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F01C71AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F01C808F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f01c71cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:55:48.414+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:56:47.817+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] MongoDB starting : pid=31994 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:56:47.826+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:56:47.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:56:48.255+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820208:255873][31994:0x7fe8436f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:56:48.255+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:56:48.275+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe842623635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE842602000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE8432DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE8430D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE842DDC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE842BC7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE8429AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE842602000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE8434E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe842623635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:56:48.275+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:57:47.754+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] MongoDB starting : pid=32221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:57:47.762+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:57:47.813+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:57:48.132+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820268:132420][32221:0x7f12be782c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:57:48.132+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:57:48.143+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12bd6b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12BD691000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF998FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12BE369000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12BE165000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12BDE6B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F12BDC56000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F12BDA39000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12BD691000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12BE572000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12bd6b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:57:48.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:58:47.257+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:58:47.265+0000 I CONTROL [initandlisten] MongoDB starting : pid=32371 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:58:47.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:58:47.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:58:47.584+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820327:584831][32371:0x7f3d3dc55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:58:47.584+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:58:47.595+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d3cb85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D3CB64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF692FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D3D83C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D3D638000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D3D33E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D3D129000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D3CF0C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D3CB64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D3DA45000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d3cb85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:58:47.595+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T14:59:47.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=32626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] modules: none 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] build environment: 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T14:59:47.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T14:59:47.773+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T14:59:48.057+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820388:57503][32626:0x7f2699614c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T14:59:48.057+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T14:59:48.067+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2698544635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2698523000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF732D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F26991FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2698FF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2698CFD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2698AE8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F26988CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2698523000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2699404000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2698544635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T14:59:48.067+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:00:47.221+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] MongoDB starting : pid=360 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:00:47.232+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:00:47.291+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:00:47.596+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820447:596063][360:0x7fd1708eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:00:47.596+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:00:47.615+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd16f81e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD16F7FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38D71000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD1704D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD1702D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD16FFD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD16FDC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD16FBA5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD16F7FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD1706DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd16f81e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:00:47.616+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:01:47.064+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] MongoDB starting : pid=587 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:01:47.071+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:01:47.121+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:01:47.401+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820507:401287][587:0x7fba39fc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:01:47.401+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:01:47.415+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba38ef3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA38ED2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA9BEF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA39BAA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA399A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA396AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA39497000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA3927A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA38ED2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA39DB3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba38ef3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:01:47.415+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:02:48.030+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] MongoDB starting : pid=824 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:02:48.038+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:02:48.088+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:02:48.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820568:429653][824:0x7fe01d76ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:02:48.429+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:02:48.440+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe01c69a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE01C679000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD166E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE01D351000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE01D14D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE01CE53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE01CC3E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE01CA21000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE01C679000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE01D55A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe01c69a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:02:48.440+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:03:47.567+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] MongoDB starting : pid=955 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:03:47.574+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:03:47.625+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:03:47.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820627:933722][955:0x7fccb56f8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:03:47.933+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:03:47.945+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fccb4628635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCB4607000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40801000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCB52DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCB50DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCB4DE1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCB4BCC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCB49AF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCB4607000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCB54E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fccb4628635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:03:47.945+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:04:47.065+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=1203 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:04:47.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:04:47.124+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:04:47.417+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820687:417732][1203:0x7f10efab4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:04:47.417+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:04:47.428+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f10ee9e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F10EE9C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F10EF69B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F10EF497000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10EF19D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10EEF88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10EED6B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F10EE9C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F10EF8A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f10ee9e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:04:47.428+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:05:47.554+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] MongoDB starting : pid=1346 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:05:47.562+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:05:47.614+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:05:47.920+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820747:920593][1346:0x7f5256526c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:05:47.920+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:05:47.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5255456635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5255435000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0440000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F525610D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5255F09000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5255C0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52559FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52557DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5255435000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5256316000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5255456635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:05:47.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:06:47.416+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] MongoDB starting : pid=1546 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:06:47.424+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:06:47.475+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:06:47.833+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820807:833870][1546:0x7f65c27a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:06:47.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:06:47.844+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65c16d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65C16B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA04FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65C2388000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65C2184000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65C1E8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65C1C75000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65C1A58000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65C16B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65C2591000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65c16d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:06:47.844+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:07:47.452+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=1770 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:07:47.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:07:47.510+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:07:47.810+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820867:810966][1770:0x7f9435b46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:07:47.811+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:07:47.828+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9434a76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9434A55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B6F5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F943572D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9435529000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F943522F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F943501A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9434DFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9434A55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9435936000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9434a76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:07:47.828+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:08:47.952+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] MongoDB starting : pid=1993 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:08:47.960+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:08:48.011+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:08:48.304+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820928:304040][1993:0x7fbfb0ca1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:08:48.304+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:08:48.314+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbfafbd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBFAFBB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF376FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBFB0888000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBFB0684000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBFB038A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBFB0175000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBFAFF58000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBFAFBB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBFB0A91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbfafbd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:08:48.314+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:09:47.448+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] MongoDB starting : pid=2107 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:09:47.456+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:09:47.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:09:47.804+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507820987:804730][2107:0x7f4d1d26ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:09:47.804+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:09:47.824+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d1c19e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D1C17D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D1CE55000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D1CC51000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D1C957000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D1C742000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D1C525000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D1C17D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D1D05E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d1c19e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:09:47.824+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:10:47.966+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] MongoDB starting : pid=2369 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:10:47.977+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:10:48.032+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:10:48.325+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821048:325920][2369:0x7ff66a2c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:10:48.326+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:10:48.338+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff6691f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF6691D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF660FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF669EAE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF669CAA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF6699B0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF66979B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF66957E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF6691D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF66A0B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff6691f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:10:48.338+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:11:47.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] MongoDB starting : pid=2605 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:11:47.832+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:11:47.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:11:48.171+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821108:171681][2605:0x7f4cbfb66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:11:48.171+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:11:48.182+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4cbea96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4CBEA75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3AE5B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4CBF74D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4CBF549000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4CBF24F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4CBF03A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4CBEE1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4CBEA75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4CBF956000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4cbea96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:11:48.182+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:12:47.307+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] MongoDB starting : pid=2833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:12:47.315+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:12:47.365+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:12:47.624+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821167:624663][2833:0x7f26674b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:12:47.624+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:12:47.646+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f26663e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F26663C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2CBB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F26670A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2666E9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2666BA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F266698D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2666770000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F26663C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F26672A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f26663e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:12:47.646+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:13:47.834+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] MongoDB starting : pid=3057 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:13:47.848+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:13:47.899+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:13:48.190+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821228:190058][3057:0x7feb35fbfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:13:48.190+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:13:48.200+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb34eef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB34ECE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB35BA6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB359A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB356A8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB35493000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB35276000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB34ECE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB35DAF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb34eef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:13:48.200+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:14:47.319+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] MongoDB starting : pid=3186 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:14:47.327+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:14:47.377+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:14:47.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821287:670080][3186:0x7f9db90f5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:14:47.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:14:47.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9db8025635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9DB8004000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF240FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9DB8CDC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9DB8AD8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9DB87DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9DB85C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9DB83AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9DB8004000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9DB8EE5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9db8025635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:14:47.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:15:47.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] MongoDB starting : pid=3442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:15:47.808+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:15:47.859+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:15:48.113+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821348:113872][3442:0x7fa9e94b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:15:48.113+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:15:48.124+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9e83e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9E83C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF508FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9E909D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9E8E99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9E8B9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9E898A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9E876D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9E83C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9E92A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9e83e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:15:48.124+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:16:47.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] MongoDB starting : pid=3679 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:16:47.611+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:16:47.660+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:16:47.996+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821407:996235][3679:0x7f275dc07c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:16:47.996+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:16:48.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f275cb37635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F275CB16000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF35C49000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F275D7EE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F275D5EA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F275D2F0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F275D0DB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F275CEBE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F275CB16000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F275D9F7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f275cb37635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:16:48.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:17:47.138+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=3915 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:17:47.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:17:47.197+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:17:47.517+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821467:517522][3915:0x7f9ef2b91c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:17:47.517+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:17:47.528+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ef1ac1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9EF1AA0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCBACA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9EF2778000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9EF2574000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9EF227A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9EF2065000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9EF1E48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9EF1AA0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9EF2981000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ef1ac1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:17:47.528+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:18:47.297+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=4128 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:18:47.305+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:18:47.355+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:18:47.625+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821527:625911][4128:0x7fa652e71c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:18:47.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:18:47.646+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa651da1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA651D80000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9C49000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA652A58000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA652854000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA65255A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA652345000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA652128000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA651D80000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA652C61000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa651da1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:18:47.646+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:19:47.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=4258 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:19:47.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:19:47.825+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:19:48.182+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821588:182843][4258:0x7f1dc6fe9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:19:48.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:19:48.202+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dc5f19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DC5EF8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79A54000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DC6BD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DC69CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DC66D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DC64BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DC62A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DC5EF8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DC6DD9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dc5f19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:19:48.202+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:20:47.323+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=4509 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:20:47.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:20:47.384+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:20:47.733+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821647:733499][4509:0x7f3753aa2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:20:47.733+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:20:47.744+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37529d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37529B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15E91000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3753689000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3753485000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F375318B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3752F76000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3752D59000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37529B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3753892000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37529d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:20:47.744+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:21:47.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=4749 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:21:47.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:21:47.196+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:21:47.469+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821707:469648][4749:0x7f789fb5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:21:47.469+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:21:47.480+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f789ea8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F789EA6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F789F746000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F789F542000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F789F248000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F789F033000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F789EE16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F789EA6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F789F94F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f789ea8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:21:47.480+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:22:47.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=5047 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:22:47.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:22:47.656+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:22:47.927+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821767:927733][5047:0x7f21f1ba1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:22:47.927+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:22:47.939+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21f0ad1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21F0AB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB50FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21F1788000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21F1584000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F21F128A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F21F1075000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21F0E58000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21F0AB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21F1991000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21f0ad1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:22:47.939+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:23:47.476+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] MongoDB starting : pid=5486 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:23:47.485+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:23:47.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:23:47.862+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821827:862394][5486:0x7ff62a4fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:23:47.862+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:23:47.873+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff62942e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF62940D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51A0C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF62A0E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF629EE1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF629BE7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF6299D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF6297B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF62940D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF62A2EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff62942e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:23:47.873+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:24:47.997+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] MongoDB starting : pid=5678 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:24:48.006+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:24:48.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:24:48.384+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821888:383998][5678:0x7f6a15670c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:24:48.384+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:24:48.394+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a145a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A1457F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A15257000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A15053000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A14D59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A14B44000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A14927000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A1457F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A15460000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a145a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:24:48.394+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:25:47.520+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] MongoDB starting : pid=6106 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:25:47.528+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:25:47.579+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:25:47.893+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507821947:893769][6106:0x7fc7ca4bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:25:47.893+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:25:47.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7c93ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7C93CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF69CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7CA0A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7C9EA0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7C9BA6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7C9991000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7C9774000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7C93CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7CA2AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7c93ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:25:47.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:26:47.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] MongoDB starting : pid=6471 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:26:47.344+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:26:47.394+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:26:47.692+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822007:692211][6471:0x7ffe70f42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:26:47.692+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:26:47.703+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe6fe72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE6FE51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90E5C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE70B29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE70925000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE7062B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE70416000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE701F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE6FE51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE70D32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe6fe72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:26:47.703+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:27:47.823+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] MongoDB starting : pid=6739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:27:47.831+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:27:47.882+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:27:48.118+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822068:118409][6739:0x7f5439913c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:27:48.118+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:27:48.129+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5438843635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5438822000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB39F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54394FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54392F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5438FFC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5438DE7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5438BCA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5438822000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5439703000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5438843635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:27:48.129+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:28:47.748+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] MongoDB starting : pid=6969 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:28:47.756+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:28:47.806+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:28:48.068+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822128:68530][6969:0x7fbebb795c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:28:48.068+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:28:48.079+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbeba6c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBEBA6A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF234FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBEBB37C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBEBB178000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBEBAE7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBEBAC69000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBEBAA4C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBEBA6A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBEBB585000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbeba6c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:28:48.079+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:29:47.218+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] MongoDB starting : pid=7102 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:29:47.226+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:29:47.275+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:29:47.594+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822187:594637][7102:0x7fa00a679c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:29:47.594+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:29:47.615+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa0095a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA009588000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA00A260000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA00A05C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA009D62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA009B4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA009930000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA009588000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA00A469000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa0095a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:29:47.615+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:30:47.747+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] MongoDB starting : pid=7368 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:30:47.755+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:30:47.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:30:48.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822248:161326][7368:0x7f9e72c95c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:30:48.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:30:48.171+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e71bc5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E71BA4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1D74000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E7287C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E72678000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E7237E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E72169000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E71F4C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E71BA4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E72A85000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e71bc5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:30:48.171+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:31:47.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:31:47.615+0000 I CONTROL [initandlisten] MongoDB starting : pid=7600 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:31:47.615+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:31:47.615+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:31:47.615+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:31:47.615+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:31:47.615+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:31:47.616+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:31:47.616+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:31:47.616+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:31:47.666+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:31:47.979+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822307:979432][7600:0x7ff92d0e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:31:47.979+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:31:47.991+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff92c018635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF92BFF7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF92CCCF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF92CACB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF92C7D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF92C5BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF92C39F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF92BFF7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF92CED8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff92c018635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:31:47.991+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:32:47.123+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] MongoDB starting : pid=7829 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:32:47.131+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:32:47.182+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:32:47.472+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822367:472865][7829:0x7f7cbd6f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:32:47.472+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:32:47.492+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7cbc622635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CBC601000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CBD2D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CBD0D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CBCDDB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CBCBC6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CBC9A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CBC601000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CBD4E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7cbc622635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:32:47.492+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:33:47.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=8040 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:33:47.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:33:47.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:33:48.224+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822428:224983][8040:0x7f86f2900c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:33:48.225+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:33:48.235+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86f1830635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86F180F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF130FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86F24E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86F22E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86F1FE9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86F1DD4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86F1BB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86F180F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86F26F0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86f1830635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:33:48.235+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:34:47.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=8177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:34:47.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:34:47.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:34:47.711+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822487:711421][8177:0x7f36780e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:34:47.711+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:34:47.732+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3677015635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3676FF4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF946FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3677CCC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3677AC8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36777CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36775B9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F367739C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3676FF4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3677ED5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3677015635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:34:47.732+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:35:47.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] MongoDB starting : pid=8427 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:35:47.871+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:35:47.920+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:35:48.265+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822548:265818][8427:0x7f15ffbdcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:35:48.265+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:35:48.276+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15feb0c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15FEAEB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFA7B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15FF7C3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15FF5BF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15FF2C5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15FF0B0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15FEE93000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15FEAEB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15FF9CC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15feb0c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:35:48.276+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:36:47.659+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] MongoDB starting : pid=8676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:36:47.667+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:36:47.717+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:36:48.073+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822608:73968][8676:0x7ff8c5534c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:36:48.074+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:36:48.093+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8c4464635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF8C4443000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF641AD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8C511B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8C4F17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8C4C1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF8C4A08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF8C47EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF8C4443000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF8C5324000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8c4464635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:36:48.093+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:37:47.231+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] MongoDB starting : pid=8900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:37:47.239+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:37:47.290+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:37:47.583+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822667:583945][8900:0x7fd10c404c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:37:47.584+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:37:47.594+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd10b334635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD10B313000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF160FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD10BFEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD10BDE7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD10BAED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD10B8D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD10B6BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD10B313000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD10C1F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd10b334635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:37:47.594+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:38:48.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=9113 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:38:48.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:38:48.104+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:38:48.372+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822728:372010][9113:0x7f3559db8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:38:48.372+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:38:48.382+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3558ce8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3558CC7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF152FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F355999F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F355979B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35594A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F355928C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F355906F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3558CC7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3559BA8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3558ce8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:38:48.382+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:39:47.510+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] MongoDB starting : pid=9246 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:39:47.518+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:39:47.567+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:39:47.849+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822787:849933][9246:0x7fcf52d62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:39:47.849+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:39:47.860+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf51c92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF51C71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF566FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF52949000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF52745000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF5244B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF52236000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF52019000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF51C71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF52B52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf51c92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:39:47.860+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:40:47.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=9461 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:40:48.001+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:40:48.050+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:40:48.342+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822848:342147][9461:0x7f29a0f2ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:40:48.342+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:40:48.361+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f299fe5a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F299FE39000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29A0B11000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29A090D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29A0613000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29A03FE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29A01E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F299FE39000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29A0D1A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f299fe5a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:40:48.361+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:41:47.785+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] MongoDB starting : pid=9634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:41:47.792+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:41:47.842+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:41:48.172+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822908:172866][9634:0x7f419361ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:41:48.172+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:41:48.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f419254a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4192529000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4193201000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4192FFD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4192D03000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4192AEE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F41928D1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4192529000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F419340A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f419254a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:41:48.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:42:47.319+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:42:47.327+0000 I CONTROL [initandlisten] MongoDB starting : pid=9864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:42:47.327+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:42:47.327+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:42:47.327+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:42:47.327+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:42:47.327+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:42:47.328+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:42:47.328+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:42:47.328+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:42:47.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:42:47.689+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507822967:689096][9864:0x7fcff6996c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:42:47.689+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:42:47.700+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcff58c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCFF58A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF798FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFF657D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFF6379000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFF607F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFF5E6A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFF5C4D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCFF58A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFF6786000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcff58c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:42:47.700+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:43:47.331+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] MongoDB starting : pid=10096 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:43:47.339+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:43:47.388+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:43:47.765+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823027:765905][10096:0x7f889a308c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:43:47.766+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:43:47.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8899238635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8899217000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1DF0E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8899EEF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8899CEB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88999F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88997DC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88995BF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8899217000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F889A0F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8899238635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:43:47.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:44:47.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] MongoDB starting : pid=10310 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:44:47.921+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:44:47.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:44:48.359+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823088:359802][10310:0x7f9aa4e6bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:44:48.359+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:44:48.379+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9aa3d9b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9AA3D7A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9AA4A52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9AA484E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9AA4554000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9AA433F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9AA4122000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9AA3D7A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9AA4C5B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9aa3d9b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:44:48.379+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:45:47.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] MongoDB starting : pid=10427 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:45:47.505+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:45:47.555+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:45:47.897+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823147:897125][10427:0x7f199dc8fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:45:47.897+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:45:47.907+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f199cbbf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F199CB9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94884000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F199D876000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F199D672000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F199D378000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F199D163000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F199CF46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F199CB9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F199DA7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f199cbbf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:45:47.907+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:46:47.296+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=10705 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:46:47.305+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:46:47.355+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:46:47.733+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823207:733177][10705:0x7f8132a4ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:46:47.733+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:46:47.753+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f813197a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8131959000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8132631000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F813242D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8132133000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8131F1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8131D01000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8131959000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F813283A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f813197a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:46:47.753+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:47:47.886+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] MongoDB starting : pid=10932 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:47:47.893+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:47:47.894+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:47:47.944+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:47:48.340+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823268:339999][10932:0x7fd3b0b3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:47:48.340+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:47:48.359+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3afa6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3AFA4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9AE28000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3B0725000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3B0521000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3B0227000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3B0012000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD3AFDF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3AFA4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3B092E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3afa6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:47:48.359+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:48:47.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:48:47.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=11140 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:48:47.471+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:48:47.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:48:47.890+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823327:890127][11140:0x7fa9aed32c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:48:47.890+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:48:47.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9adc62635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9ADC41000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D2C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9AE919000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9AE715000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9AE41B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9AE206000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9ADFE9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9ADC41000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9AEB22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9adc62635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:48:47.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:49:48.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=11354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:49:48.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:49:48.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:49:48.387+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823388:387360][11354:0x7f627d5ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:49:48.387+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:49:48.397+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f627c51c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F627C4FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F627D1D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F627CFCF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F627CCD5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F627CAC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F627C8A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F627C4FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F627D3DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f627c51c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:49:48.397+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:50:47.522+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] MongoDB starting : pid=11473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:50:47.529+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:50:47.579+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:50:47.863+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823447:863231][11473:0x7f3549bdbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:50:47.863+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:50:47.873+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3548b0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3548AEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F35497C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F35495BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35492C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F35490AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3548E92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3548AEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F35499CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3548b0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:50:47.873+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:51:47.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=11746 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:51:47.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:51:47.275+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:51:47.275+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:51:47.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:51:47.678+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823507:678078][11746:0x7f80ebbb1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:51:47.678+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:51:47.688+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80eaae1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80EAAC0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB74FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80EB798000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80EB594000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80EB29A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80EB085000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80EAE68000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80EAAC0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80EB9A1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80eaae1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:51:47.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:52:47.808+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=11975 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:52:47.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:52:47.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:52:48.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823568:161700][11975:0x7f6276232c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:52:48.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:52:48.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6275162635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6275141000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF59569000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6275E19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6275C15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F627591B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6275706000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62754E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6275141000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6276022000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6275162635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:52:48.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:53:47.976+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] MongoDB starting : pid=12185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:53:47.984+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:53:48.036+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:53:48.405+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823628:405138][12185:0x7f6156df6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:53:48.405+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:53:48.424+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6155d26635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6155D05000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82DCC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61569DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61567D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61564DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61562CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61560AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6155D05000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6156BE6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6155d26635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:53:48.424+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:54:47.547+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] MongoDB starting : pid=12402 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:54:47.554+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:54:47.604+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:54:47.942+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823687:942491][12402:0x7ff58474cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:54:47.942+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:54:47.962+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff58367c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF58365B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF67AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF584333000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF58412F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF583E35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF583C20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF583A03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF58365B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF58453C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff58367c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:54:47.962+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:55:47.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=12516 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:55:47.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:55:47.173+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:55:47.487+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823747:487530][12516:0x7f2bd756cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:55:47.487+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:55:47.498+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2bd649c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2BD647B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB74D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2BD7153000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2BD6F4F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2BD6C55000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2BD6A40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2BD6823000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2BD647B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2BD735C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2bd649c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:55:47.498+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:56:47.907+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] MongoDB starting : pid=12807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:56:47.915+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:56:47.966+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:56:48.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823808:266448][12807:0x7fddeac15c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:56:48.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:56:48.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdde9b45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDDE9B24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDDEA7FC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDDEA5F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDDEA2FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDDEA0E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDDE9ECC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDDE9B24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDDEAA05000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdde9b45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:56:48.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:57:47.409+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] MongoDB starting : pid=13035 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:57:47.417+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:57:47.472+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:57:47.757+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823867:757132][13035:0x7f1455980c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:57:47.757+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:57:47.767+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14548b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F145488F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A89F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1455567000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1455363000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1455069000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1454E54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1454C37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F145488F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1455770000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14548b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:57:47.767+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:58:47.222+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] MongoDB starting : pid=13261 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:58:47.229+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:58:47.278+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:58:47.532+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823927:532735][13261:0x7fc65ecc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:58:47.532+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:58:47.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc65dbf3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC65DBD2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF818FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC65E8AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC65E6A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC65E3AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC65E197000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC65DF7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC65DBD2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC65EAB3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc65dbf3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:58:47.543+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T15:59:47.674+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] MongoDB starting : pid=13476 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] modules: none 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] build environment: 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T15:59:47.681+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T15:59:47.731+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T15:59:48.011+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507823988:11367][13476:0x7f67a22a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T15:59:48.011+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T15:59:48.021+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67a11d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67A11B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67A1E90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67A1C8C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67A1992000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67A177D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67A1560000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67A11B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67A2099000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67a11d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T15:59:48.021+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:00:47.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=13595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:00:47.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:00:47.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:00:47.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:00:47.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:00:47.501+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824047:501412][13595:0x7fdd5107ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:00:47.501+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:00:47.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd4ffae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD4FF8D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF67AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD50C65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD50A61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD50767000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD50552000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD50335000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD4FF8D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD50E6E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd4ffae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:00:47.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:01:47.967+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] MongoDB starting : pid=13874 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:01:47.974+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:01:48.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:01:48.334+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824108:334867][13874:0x7ff91206cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:01:48.334+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:01:48.345+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff910f9c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF910F7B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF911C53000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF911A4F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF911755000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF911540000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF911323000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF910F7B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF911E5C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff910f9c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:01:48.345+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:02:47.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=14108 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:02:47.798+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:02:47.849+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:02:48.116+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824168:116530][14108:0x7fe110777c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:02:48.116+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:02:48.127+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe10f6a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE10F686000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE11035E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE11015A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE10FE60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE10FC4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE10FA2E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE10F686000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE110567000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe10f6a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:02:48.127+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:03:47.781+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:03:47.788+0000 I CONTROL [initandlisten] MongoDB starting : pid=14316 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:03:47.789+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:03:47.844+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:03:48.217+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824228:217308][14316:0x7f0c4bb55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:03:48.217+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:03:48.236+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c4aa85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C4AA64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF170A7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C4B73C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C4B538000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C4B23E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C4B029000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C4AE0C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C4AA64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C4B945000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c4aa85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:03:48.236+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:04:47.363+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] MongoDB starting : pid=14841 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:04:47.370+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:04:47.421+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:04:47.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824287:751214][14841:0x7fd62c422c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:04:47.751+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:04:47.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd62b352635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD62B331000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D246000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD62C009000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD62BE05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD62BB0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD62B8F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD62B6D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD62B331000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD62C212000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd62b352635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:04:47.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:05:47.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=15014 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:05:47.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:05:47.957+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:05:48.289+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824348:289614][15014:0x7f0e9282bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:05:48.289+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:05:48.302+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e9175b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E9173A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E92412000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E9220E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E91F14000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E91CFF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E91AE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E9173A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E9261B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e9175b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:05:48.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:06:47.696+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] MongoDB starting : pid=15302 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:06:47.703+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:06:47.704+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:06:47.704+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:06:47.754+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:06:48.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824408:152213][15302:0x7fab2a927c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:06:48.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:06:48.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fab29857635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAB29836000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAB2A50E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB2A30A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB2A010000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB29DFB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB29BDE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB29836000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB2A717000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fab29857635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:06:48.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:07:47.306+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] MongoDB starting : pid=15547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:07:47.313+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:07:47.314+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:07:47.365+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:07:47.731+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824467:731425][15547:0x7fe61941bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:07:47.731+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:07:47.751+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe61834b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE61832A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF056FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE619002000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE618DFE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE618B04000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE6188EF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE6186D2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE61832A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE61920B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe61834b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:07:47.751+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:08:47.288+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] MongoDB starting : pid=15776 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:08:47.295+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:08:47.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:08:47.659+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824527:659433][15776:0x7fd183277c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:08:47.659+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:08:47.671+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd1821a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD182186000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD182E5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD182C5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD182960000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD18274B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD18252E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD182186000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD183067000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd1821a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:08:47.671+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:09:47.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=15995 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:09:47.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:09:47.856+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:09:48.154+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824588:154082][15995:0x7fd55ee3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:09:48.154+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:09:48.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd55dd70635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD55DD4F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FD55F74F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD55EA27000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD55E823000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD55E529000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD55E314000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD55E0F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD55DD4F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD55EC30000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd55dd70635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:09:48.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:10:47.303+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=16121 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:10:47.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:10:47.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:10:47.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824647:674244][16121:0x7faa1e768c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:10:47.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:10:47.684+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa1d698635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA1D677000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF136FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA1E34F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA1E14B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA1DE51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA1DC3C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA1DA1F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA1D677000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA1E558000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa1d698635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:10:47.684+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:11:47.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] MongoDB starting : pid=16405 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:11:47.081+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:11:47.082+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:11:47.131+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:11:47.482+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824707:482455][16405:0x7faada99cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:11:47.482+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:11:47.502+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faad98cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAAD98AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB4CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAADA583000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAADA37F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAADA085000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAAD9E70000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAAD9C53000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAAD98AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAADA78C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faad98cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:11:47.502+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:12:47.627+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] MongoDB starting : pid=16722 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:12:47.635+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:12:47.685+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:12:47.983+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824767:983148][16722:0x7fc06b3bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:12:47.983+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:12:47.994+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc06a2ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC06A2CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF016F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC06AFA5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC06ADA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC06AAA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC06A892000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC06A675000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC06A2CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC06B1AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc06a2ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:12:47.994+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:13:47.620+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] MongoDB starting : pid=16949 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:13:47.627+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:13:47.678+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:13:48.002+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824828:2436][16949:0x7f00e12e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:13:48.002+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:13:48.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00e0214635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00E01F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00E0ECB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00E0CC7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00E09CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00E07B8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00E059B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00E01F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00E10D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00e0214635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:13:48.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:14:47.138+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=17167 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:14:47.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:14:47.195+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:14:47.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824887:463554][17167:0x7f6ccf96cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:14:47.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:14:47.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6cce89c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6CCE87B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6CCF553000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6CCF34F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6CCF055000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6CCEE40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6CCEC23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6CCE87B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6CCF75C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6cce89c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:14:47.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:15:47.591+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] MongoDB starting : pid=17291 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:15:47.599+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:15:47.648+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:15:48.013+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507824948:13446][17291:0x7f3b6e368c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:15:48.013+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:15:48.023+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b6d298635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B6D277000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3B6DF4F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3B6DD4B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3B6DA51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3B6D83C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B6D61F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B6D277000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3B6E158000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b6d298635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:15:48.024+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:16:47.437+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] MongoDB starting : pid=17506 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:16:47.446+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:16:47.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:16:47.781+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825007:781099][17506:0x7f38047b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:16:47.781+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:16:47.791+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f38036e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38036C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD6A3F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F380439F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F380419B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3803EA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3803C8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3803A6F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38036C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38045A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f38036e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:16:47.791+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:17:47.922+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] MongoDB starting : pid=17763 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:17:47.929+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:17:47.979+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:17:48.264+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825068:264760][17763:0x7f3157b5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:17:48.264+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:17:48.275+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3156a8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3156A6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3157746000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3157542000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3157248000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3157033000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3156E16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3156A6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F315794F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3156a8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:17:48.275+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:18:47.109+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] MongoDB starting : pid=17979 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:18:47.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:18:47.167+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:18:47.527+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825127:527452][17979:0x7f838cb8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:18:47.527+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:18:47.538+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f838babd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F838BA9C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0CA06000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F838C774000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F838C570000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F838C276000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F838C061000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F838BE44000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F838BA9C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F838C97D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f838babd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:18:47.538+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:19:47.657+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] MongoDB starting : pid=18199 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:19:47.664+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:19:47.714+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:19:48.039+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825188:39942][18199:0x7feb32083c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:19:48.040+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:19:48.050+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb30fb3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB30F92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000002FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB31C6A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB31A66000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB3176C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB31557000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB3133A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB30F92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB31E73000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb30fb3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:19:48.050+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:20:47.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:20:47.189+0000 I CONTROL [initandlisten] MongoDB starting : pid=18408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:20:47.189+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:20:47.189+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:20:47.189+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:20:47.189+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:20:47.190+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:20:47.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:20:47.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:20:47.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:20:47.240+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:20:47.530+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825247:530139][18408:0x7f841d255c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:20:47.530+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:20:47.540+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f841c185635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F841C164000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA0B7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F841CE3C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F841CC38000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F841C93E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F841C729000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F841C50C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F841C164000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F841D045000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f841c185635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:20:47.540+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:21:47.939+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] MongoDB starting : pid=18555 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:21:47.948+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:21:47.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:21:48.342+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825308:342450][18555:0x7f152bdeec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:21:48.342+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:21:48.361+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f152ad1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F152ACFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "80000068C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F152B9D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F152B7D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F152B4D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F152B2C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F152B0A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F152ACFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F152BBDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f152ad1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:21:48.361+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:22:47.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] MongoDB starting : pid=18849 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:22:47.506+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:22:47.557+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:22:47.916+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825367:916324][18849:0x7f7dd9d6ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:22:47.916+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:22:47.937+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dd8c9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DD8C7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F39D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DD9955000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DD9751000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DD9457000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DD9242000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DD9025000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DD8C7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DD9B5E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dd8c9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:22:47.937+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:23:47.647+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=19077 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:23:47.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:23:47.703+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:23:47.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825427:963656][19077:0x7f68e54acc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:23:47.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:23:47.982+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68e43dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68E43BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68E5093000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68E4E8F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68E4B95000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68E4980000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68E4763000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68E43BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68E529C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68e43dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:23:47.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:24:47.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=19298 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:24:47.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:24:47.155+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:24:47.433+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825487:433534][19298:0x7f678b0f5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:24:47.433+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:24:47.444+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f678a025635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F678A004000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF582FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F678ACDC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F678AAD8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F678A7DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F678A5C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F678A3AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F678A004000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F678AEE5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f678a025635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:24:47.444+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:25:47.570+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] MongoDB starting : pid=19505 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:25:47.577+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:25:47.627+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:25:47.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825547:964624][19505:0x7fc09c7f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:25:47.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:25:47.975+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc09b727635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC09B706000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC09C3DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC09C1DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC09BEE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC09BCCB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC09BAAE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC09B706000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC09C5E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc09b727635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:25:47.975+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:26:47.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=19654 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:26:47.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:26:47.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:26:47.681+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825607:681560][19654:0x7f5615555c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:26:47.681+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:26:47.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5614485635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5614464000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4EEFD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F561513C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5614F38000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5614C3E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5614A29000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F561480C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5614464000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5615345000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5614485635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:26:47.692+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:27:47.831+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] MongoDB starting : pid=19930 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:27:47.838+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:27:47.888+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:27:48.164+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825668:164466][19930:0x7f48b9dfdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:27:48.164+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:27:48.175+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f48b8d2d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F48B8D0C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F48B99E4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F48B97E0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F48B94E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F48B92D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F48B90B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F48B8D0C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F48B9BED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f48b8d2d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:27:48.175+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:28:47.916+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] MongoDB starting : pid=20175 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:28:47.924+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:28:47.974+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:28:48.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825728:274297][20175:0x7f8e05ed5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:28:48.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:28:48.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e04e05635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E04DE4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6B96000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E05ABC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E058B8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E055BE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E053A9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E0518C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E04DE4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E05CC5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e04e05635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:28:48.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:29:47.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] MongoDB starting : pid=20390 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:29:47.427+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:29:47.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:29:47.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825787:782559][20390:0x7fc281388c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:29:47.782+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:29:47.802+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc2802b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC280297000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC280F6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC280D6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC280A71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC28085C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC28063F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC280297000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC281178000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc2802b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:29:47.802+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:30:47.928+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] MongoDB starting : pid=20595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:30:47.935+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:30:47.984+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:30:48.279+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825848:279955][20595:0x7f981888ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:30:48.280+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:30:48.290+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f98177be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F981779D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5C8D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9818475000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9818271000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9817F77000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9817D62000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9817B45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F981779D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F981867E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f98177be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:30:48.290+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:31:47.797+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] MongoDB starting : pid=20736 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:31:47.805+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:31:47.854+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:31:48.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825908:158909][20736:0x7f04b5389c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:31:48.158+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:31:48.170+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f04b42b9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F04B4298000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF896FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04B4F70000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04B4D6C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04B4A72000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04B485D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04B4640000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F04B4298000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04B5179000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f04b42b9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:31:48.170+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:32:47.298+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:32:47.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=21028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:32:47.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:32:47.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:32:47.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:32:47.306+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:32:47.306+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:32:47.306+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:32:47.306+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:32:47.306+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:32:47.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:32:47.657+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507825967:657938][21028:0x7f3aae820c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:32:47.657+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:32:47.668+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3aad750635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3AAD72F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC82FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3AAE407000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3AAE203000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3AADF09000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3AADCF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3AADAD7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3AAD72F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3AAE610000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3aad750635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:32:47.668+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:33:47.095+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] MongoDB starting : pid=21267 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:33:47.103+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:33:47.153+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:33:47.430+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826027:430396][21267:0x7ff12550dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:33:47.430+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:33:47.440+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff12443d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF12441C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF903F7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF1250F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF124EF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF124BF6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1249E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1247C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF12441C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1252FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff12443d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:33:47.440+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:34:47.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=21497 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:34:47.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:34:47.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:34:47.969+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826087:969369][21497:0x7fd57c266c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:34:47.969+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:34:47.982+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd57b196635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD57B175000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF83798000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD57BE4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD57BC49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD57B94F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD57B73A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD57B51D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD57B175000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD57C056000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd57b196635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:34:47.982+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:35:47.099+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] MongoDB starting : pid=21701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:35:47.106+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:35:47.107+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:35:47.157+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:35:47.456+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826147:456431][21701:0x7f95a29a6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:35:47.456+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:35:47.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f95a18d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F95A18B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCECE7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F95A258D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F95A2389000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F95A208F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F95A1E7A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F95A1C5D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F95A18B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F95A2796000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f95a18d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:35:47.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:36:47.850+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] MongoDB starting : pid=21869 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:36:47.857+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:36:47.907+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:36:48.187+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826208:187957][21869:0x7fb6c3b5ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:36:48.188+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:36:48.198+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb6c2a8e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB6C2A6D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97A82000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB6C3745000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB6C3541000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB6C3247000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB6C3032000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB6C2E15000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB6C2A6D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB6C394E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb6c2a8e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:36:48.198+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:37:47.330+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] MongoDB starting : pid=22139 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:37:47.337+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:37:47.387+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:37:47.723+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826267:723751][22139:0x7f2fb7faec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:37:47.723+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:37:47.734+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2fb6ede635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FB6EBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF50EFC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FB7B95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FB7991000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FB7697000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FB7482000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FB7265000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FB6EBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FB7D9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2fb6ede635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:37:47.734+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:38:47.256+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] MongoDB starting : pid=22382 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:38:47.263+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:38:47.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:38:47.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826327:707419][22382:0x7f6584e88c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:38:47.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:38:47.728+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6583db8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6583D97000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7321C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6584A6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F658486B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6584571000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F658435C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F658413F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6583D97000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6584C78000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6583db8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:38:47.728+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:39:47.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] MongoDB starting : pid=22600 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:39:47.873+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:39:47.923+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:39:48.299+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826388:299473][22600:0x7f6a777eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:39:48.299+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:39:48.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a7671a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A766F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4CBF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A773D1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A771CD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A76ED3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A76CBE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A76AA1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A766F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A775DA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a7671a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:39:48.319+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:40:47.460+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] MongoDB starting : pid=22802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:40:47.469+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:40:47.522+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:40:47.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826447:894075][22802:0x7f031bce6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:40:47.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:40:47.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f031ac16635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F031ABF5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D4CE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F031B8CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F031B6C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F031B3CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F031B1BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F031AF9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F031ABF5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F031BAD6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f031ac16635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:40:47.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:41:47.334+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] MongoDB starting : pid=22956 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:41:47.341+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:41:47.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:41:47.673+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826507:673948][22956:0x7f6f90691c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:41:47.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:41:47.684+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f8f5c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F8F5A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA439A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F90278000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F90074000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F8FD7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F8FB65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F8F948000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F8F5A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F90481000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f8f5c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:41:47.684+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:42:47.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=23213 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:42:47.809+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:42:47.859+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:42:48.106+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826568:106891][23213:0x7f9cec550c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:42:48.106+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:42:48.117+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ceb480635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9CEB45F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE42FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9CEC137000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9CEBF33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9CEBC39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9CEBA24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9CEB807000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9CEB45F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9CEC340000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ceb480635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:42:48.117+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:43:47.246+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] MongoDB starting : pid=23461 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:43:47.253+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:43:47.306+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:43:47.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826627:661194][23461:0x7f8f7487fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:43:47.661+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:43:47.680+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f737af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F7378E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48F6E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F74466000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F74262000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F73F68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F73D53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F73B36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F7378E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F7466F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f737af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:43:47.680+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:44:47.805+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] MongoDB starting : pid=23680 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:44:47.812+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:44:47.863+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:44:48.111+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826688:111947][23680:0x7fa8bb3bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:44:48.112+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:44:48.122+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8ba2ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8BA2C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8BAFA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8BAD9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8BAAA3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8BA88E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8BA671000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8BA2C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8BB1AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8ba2ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:44:48.122+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:45:47.236+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] MongoDB starting : pid=23893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:45:47.240+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:45:47.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:45:47.498+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826747:498224][23893:0x7f9c31d77c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:45:47.498+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:45:47.509+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c30ca7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C30C86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEF4C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C3195E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C3175A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C31460000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C3124B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C3102E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C30C86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C31B67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c30ca7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:45:47.509+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:46:47.954+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] MongoDB starting : pid=24045 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:46:47.961+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:46:48.010+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:46:48.310+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826808:310169][24045:0x7fdce4d63c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:46:48.310+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:46:48.330+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdce3c93635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCE3C72000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9C23000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCE494A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCE4746000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCE444C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCE4237000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCE401A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCE3C72000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCE4B53000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdce3c93635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:46:48.330+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:47:47.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] MongoDB starting : pid=24312 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:47:47.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:47:47.507+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:47:47.797+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826867:797319][24312:0x7fdcda629c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:47:47.797+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:47:47.808+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdcd9559635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCD9538000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF44CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCDA210000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCDA00C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCD9D12000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCD9AFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCD98E0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCD9538000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCDA419000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdcd9559635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:47:47.808+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:48:47.935+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] MongoDB starting : pid=24550 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:48:47.942+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:48:47.993+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:48:48.244+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826928:244767][24550:0x7fa816004c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:48:48.244+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:48:48.255+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa814f34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA814F13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA815BEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8159E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8156ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8154D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8152BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA814F13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA815DF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa814f34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:48:48.255+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:49:47.322+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] MongoDB starting : pid=24745 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:49:47.329+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:49:47.381+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:49:47.728+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507826987:728147][24745:0x7fd8546ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:49:47.728+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:49:47.738+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8535fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8535DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD8542B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD8540AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD853DB5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD853BA0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD853983000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8535DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8544BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8535fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:49:47.738+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:50:47.856+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] MongoDB starting : pid=24960 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:50:47.864+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:50:47.913+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:50:48.235+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827048:235602][24960:0x7f1f8fc02c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:50:48.235+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:50:48.246+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f8eb32635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F8EB11000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF40FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F8F7E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F8F5E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F8F2EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F8F0D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F8EEB9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F8EB11000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F8F9F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f8eb32635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:50:48.246+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:51:47.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=25107 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:51:47.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:51:47.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:51:48.045+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827108:45504][25107:0x7fa1f6eacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:51:48.045+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:51:48.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1f5ddc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1F5DBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF50CCD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1F6A93000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1F688F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1F6595000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1F6380000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1F6163000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1F5DBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1F6C9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1f5ddc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:51:48.066+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:52:47.186+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] MongoDB starting : pid=25216 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:52:47.194+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:52:47.243+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:52:47.610+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827167:610181][25216:0x7f27e047fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:52:47.610+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:52:47.629+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27df3af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F27DF38E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4407B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27E0066000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27DFE62000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F27DFB68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F27DF953000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F27DF736000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F27DF38E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27E026F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27df3af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:52:47.630+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:53:47.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=25508 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:53:47.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:53:47.833+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:53:48.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827228:152943][25508:0x7f2c8f862c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:53:48.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:53:48.163+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c8e792635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C8E771000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF9BEC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C8F449000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C8F245000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C8EF4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C8ED36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C8EB19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C8E771000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C8F652000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c8e792635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:53:48.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:54:47.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] MongoDB starting : pid=25710 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:54:47.447+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:54:47.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:54:47.826+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827287:826493][25710:0x7f4bb9088c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:54:47.826+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:54:47.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4bb7fb8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4BB7F97000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFDBE6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4BB8C6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4BB8A6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4BB8771000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4BB855C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4BB833F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4BB7F97000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4BB8E78000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4bb7fb8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:54:47.837+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:55:47.956+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] MongoDB starting : pid=25928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:55:47.963+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:55:48.013+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:55:48.303+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827348:303201][25928:0x7f29a9c31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:55:48.303+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:55:48.316+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29a8b61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29A8B40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29A9818000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29A9614000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29A931A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29A9105000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29A8EE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29A8B40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29A9A21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29a8b61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:55:48.316+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:56:47.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] MongoDB starting : pid=26159 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:56:47.733+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:56:47.784+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:56:48.109+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827408:109661][26159:0x7fca35c74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:56:48.109+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:56:48.120+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca34ba4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA34B83000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA3585B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA35657000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA3535D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA35148000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA34F2B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA34B83000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA35A64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca34ba4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:56:48.120+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:57:47.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=26284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:57:47.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:57:47.299+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:57:47.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827467:661358][26284:0x7ff09f532c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:57:47.661+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:57:47.682+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff09e462635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF09E441000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF09F119000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF09EF15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF09EC1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF09EA06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF09E7E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF09E441000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF09F322000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff09e462635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:57:47.682+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:58:47.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=26580 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:58:47.809+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:58:47.858+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:58:48.134+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827528:134026][26580:0x7f33791fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:58:48.134+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:58:48.144+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f337812d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F337810C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF86FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3378DE4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3378BE0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33788E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33786D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33784B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F337810C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3378FED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f337812d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:58:48.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T16:59:47.691+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] MongoDB starting : pid=26791 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] modules: none 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] build environment: 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T16:59:47.698+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T16:59:47.747+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T16:59:48.051+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827588:51686][26791:0x7f6e5c103c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T16:59:48.051+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T16:59:48.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e5b033635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E5B012000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC997D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E5BCEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E5BAE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E5B7EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E5B5D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E5B3BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E5B012000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E5BEF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e5b033635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T16:59:48.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:00:47.183+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] MongoDB starting : pid=27008 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:00:47.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:00:47.240+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:00:47.534+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827647:534593][27008:0x7f0abdb84c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:00:47.534+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:00:47.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0abcab4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0ABCA93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0ABD76B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0ABD567000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0ABD26D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0ABD058000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0ABCE3B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0ABCA93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0ABD974000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0abcab4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:00:47.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:01:48.017+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] MongoDB starting : pid=27238 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:01:48.024+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:01:48.074+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:01:48.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827708:318706][27238:0x7f7ee9f0cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:01:48.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:01:48.329+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ee8e3c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EE8E1B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2D6F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EE9AF3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EE98EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EE95F5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EE93E0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EE91C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EE8E1B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EE9CFC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ee8e3c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:01:48.329+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:02:47.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=27379 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:02:47.758+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:02:47.808+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:02:48.065+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827768:65787][27379:0x7f238efc8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:02:48.065+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:02:48.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f238def8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F238DED7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8EBD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F238EBAF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F238E9AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F238E6B1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F238E49C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F238E27F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F238DED7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F238EDB8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f238def8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:02:48.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:03:47.207+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] MongoDB starting : pid=27676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:03:47.214+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:03:47.264+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:03:47.510+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827827:510700][27676:0x7f6297a73c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:03:47.510+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:03:47.521+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62969a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6296982000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95677000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F629765A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6297456000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F629715C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6296F47000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6296D2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6296982000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6297863000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62969a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:03:47.521+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:04:47.938+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:04:47.944+0000 I CONTROL [initandlisten] MongoDB starting : pid=27877 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:04:47.944+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:04:47.944+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:04:47.944+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:04:47.944+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:04:47.944+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:04:47.945+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:04:47.945+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:04:47.945+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:04:47.994+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:04:48.252+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827888:252445][27877:0x7f01991f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:04:48.252+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:04:48.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0198129635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0198108000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF286FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0198DE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0198BDC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01988E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01986CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01984B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0198108000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0198FE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0198129635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:04:48.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:05:47.397+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] MongoDB starting : pid=28087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:05:47.404+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:05:47.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:05:47.745+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507827947:745740][28087:0x7f70182b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:05:47.745+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:05:47.756+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f70171e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F70171C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1DCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7017E9F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7017C9B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F70179A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F701778C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F701756F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F70171C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F70180A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f70171e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:05:47.756+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:06:47.198+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:06:47.205+0000 I CONTROL [initandlisten] MongoDB starting : pid=28295 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:06:47.205+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:06:47.206+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:06:47.255+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:06:47.541+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828007:541270][28295:0x7f747c61fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:06:47.541+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:06:47.560+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f747b54f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F747B52E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF064D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F747C206000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F747C002000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F747BD08000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F747BAF3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F747B8D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F747B52E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F747C40F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f747b54f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:06:47.560+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:07:47.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] MongoDB starting : pid=28427 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:07:47.694+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:07:47.744+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:07:48.008+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828068:8410][28427:0x7f27537fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:07:48.008+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:07:48.018+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f275272e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F275270D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB04FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27533E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27531E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2752EE7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2752CD2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2752AB5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F275270D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27535EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f275272e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:07:48.018+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:08:47.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] MongoDB starting : pid=28727 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:08:47.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:08:47.209+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:08:47.539+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828127:539075][28727:0x7f5153addc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:08:47.539+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:08:47.549+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5152a0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51529EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A9D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51536C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51534C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51531C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5152FB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5152D94000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51529EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51538CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5152a0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:08:47.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:09:47.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=28934 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:09:47.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:09:47.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:09:47.520+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828187:520452][28934:0x7f63876bcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:09:47.520+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:09:47.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63865ec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63865CB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA50FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63872A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F638709F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6386DA5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6386B90000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6386973000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63865CB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F63874AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63865ec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:09:47.531+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:10:47.663+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] MongoDB starting : pid=29150 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:10:47.670+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:10:47.720+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:10:47.996+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828247:996508][29150:0x7f3d23b73c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:10:47.996+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:10:48.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d22aa3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D22A82000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF096FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D2375A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D23556000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D2325C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D23047000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D22E2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D22A82000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D23963000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d22aa3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:10:48.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:11:47.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:11:47.433+0000 I CONTROL [initandlisten] MongoDB starting : pid=29369 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:11:47.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:11:47.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:11:47.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:11:47.434+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:11:47.434+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:11:47.434+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:11:47.434+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:11:47.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:11:47.487+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:11:47.769+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828307:769068][29369:0x7f8b68e0bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:11:47.769+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:11:47.788+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b67d3b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B67D1A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF258FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B689F2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B687EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B684F4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B682DF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B680C2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B67D1A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B68BFB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b67d3b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:11:47.788+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:12:47.913+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] MongoDB starting : pid=29509 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:12:47.920+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:12:47.970+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:12:48.239+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828368:239396][29509:0x7ff5a9a1dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:12:48.239+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:12:48.250+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff5a894d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF5A892C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE073000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF5A9604000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF5A9400000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF5A9106000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF5A8EF1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF5A8CD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF5A892C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF5A980D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff5a894d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:12:48.250+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:13:47.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] MongoDB starting : pid=29813 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:13:47.386+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:13:47.436+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:13:47.730+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828427:730309][29813:0x7ff144223c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:13:47.730+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:13:47.749+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff143153635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF143132000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56608000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF143E0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF143C06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF14390C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1436F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1434DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF143132000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF144013000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff143153635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:13:47.749+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:14:47.409+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:14:47.420+0000 I CONTROL [initandlisten] MongoDB starting : pid=30023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:14:47.421+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:14:47.480+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:14:47.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828487:782558][30023:0x7f2f6ba90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:14:47.782+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:14:47.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f6a9c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F6A99F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C62F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F6B677000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F6B473000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F6B179000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F6AF64000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F6AD47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F6A99F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F6B880000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f6a9c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:14:47.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:15:47.927+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] MongoDB starting : pid=30233 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:15:47.935+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:15:47.985+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:15:48.259+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828548:259139][30233:0x7fa5449c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:15:48.259+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:15:48.269+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5438f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5438D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF406FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5445A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5443A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5440AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA543E95000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA543C78000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5438D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5447B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5438f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:15:48.269+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:16:47.709+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] MongoDB starting : pid=30444 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:16:47.716+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:16:47.767+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:16:48.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828608:3030][30444:0x7f99b5012c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:16:48.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:16:48.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99b3f42635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99B3F21000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF732D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99B4BF9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99B49F5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99B46FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99B44E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99B42C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99B3F21000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99B4E02000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99b3f42635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:16:48.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:17:47.130+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] MongoDB starting : pid=30586 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:17:47.137+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:17:47.186+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:17:47.551+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828667:551023][30586:0x7f00804d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:17:47.551+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:17:47.571+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f007f407635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F007F3E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF114FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00800BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F007FEBA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F007FBC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F007F9AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F007F78E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F007F3E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00802C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f007f407635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:17:47.571+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:18:47.707+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=30876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:18:47.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:18:47.765+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:18:48.084+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828728:84322][30876:0x7f8bfa576c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:18:48.084+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:18:48.103+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8bf94a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BF9485000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3FDB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BFA15D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BF9F59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BF9C5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BF9A4A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BF982D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BF9485000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BFA366000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8bf94a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:18:48.103+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:19:47.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] MongoDB starting : pid=31077 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:19:47.594+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:19:47.645+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:19:47.898+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828787:898368][31077:0x7f78cd86bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:19:47.898+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:19:47.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78cc79b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78CC77A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF69E6C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78CD452000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78CD24E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78CCF54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78CCD3F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78CCB22000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78CC77A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78CD65B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78cc79b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:19:47.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:20:48.031+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] MongoDB starting : pid=31288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:20:48.035+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:20:48.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:20:48.376+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828848:376915][31288:0x7fc3235ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:20:48.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:20:48.396+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc32251b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC3224FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E484000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3231D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC322FCE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC322CD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC322ABF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3228A2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3224FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3233DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc32251b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:20:48.396+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:21:47.801+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=31500 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:21:47.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:21:47.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:21:48.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828908:129374][31500:0x7f6c3bb47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:21:48.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:21:48.139+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6c3aa77635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6C3AA56000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF05BF3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C3B72E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C3B52A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C3B230000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C3B01B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6C3ADFE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6C3AA56000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C3B937000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6c3aa77635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:21:48.139+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:22:47.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=31642 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:22:47.274+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:22:47.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:22:47.610+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507828967:610614][31642:0x7f7c5c840c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:22:47.610+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:22:47.621+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c5b770635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C5B74F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF68EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C5C427000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C5C223000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C5BF29000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C5BD14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C5BAF7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C5B74F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C5C630000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c5b770635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:22:47.621+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:23:47.756+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] MongoDB starting : pid=31928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:23:47.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:23:47.813+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:23:48.105+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829028:105463][31928:0x7f6e2fc41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:23:48.105+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:23:48.115+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e2eb71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E2EB50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB42FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E2F828000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E2F624000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E2F32A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E2F115000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E2EEF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E2EB50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E2FA31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e2eb71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:23:48.115+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:24:47.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=32138 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:24:47.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:24:47.884+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:24:48.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829088:158833][32138:0x7fed0475ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:24:48.158+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:24:48.178+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed0368e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED0366D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC3DDA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED04345000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED04141000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED03E47000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED03C32000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED03A15000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED0366D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED0454E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed0368e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:24:48.178+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:25:47.303+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] MongoDB starting : pid=32352 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:25:47.311+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:25:47.362+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:25:47.680+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829147:680225][32352:0x7f5c0d9bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:25:47.680+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:25:47.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c0c8ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C0C8CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC82FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C0D5A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C0D3A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C0D0A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C0CE91000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C0CC74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C0C8CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C0D7AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c0c8ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:25:47.690+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:26:47.079+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] MongoDB starting : pid=32508 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:26:47.086+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:26:47.136+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:26:47.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829207:463217][32508:0x7fcb26cd3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:26:47.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:26:47.483+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb25c03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB25BE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF716DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB268BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB266B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB263BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB261A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB25F8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB25BE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB26AC3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb25c03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:26:47.483+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:27:47.611+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] MongoDB starting : pid=32695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:27:47.618+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:27:47.670+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:27:48.001+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829268:1748][32695:0x7f66cb1b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:27:48.001+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:27:48.021+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f66ca0e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F66CA0C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF562FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F66CADA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F66CAB9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F66CA8A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F66CA68D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F66CA470000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F66CA0C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F66CAFA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f66ca0e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:27:48.021+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:28:47.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=397 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:28:47.158+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:28:47.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:28:47.492+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829327:492531][397:0x7f7f4c015c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:28:47.492+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:28:47.502+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f4af45635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F4AF24000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC3A1A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F4BBFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F4B9F8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F4B6FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F4B4E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F4B2CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F4AF24000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F4BE05000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f4af45635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:28:47.502+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:29:47.353+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] MongoDB starting : pid=647 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:29:47.362+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:29:47.412+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:29:47.724+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829387:724264][647:0x7fa090244c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:29:47.724+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:29:47.735+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa08f174635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA08F153000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF392FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA08FE2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA08FC27000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA08F92D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA08F718000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA08F4FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA08F153000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA090034000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa08f174635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:29:47.735+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:30:47.870+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] MongoDB starting : pid=861 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:30:47.877+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:30:47.878+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:30:47.930+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:30:48.183+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829448:183108][861:0x7f8bdafb9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:30:48.183+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:30:48.193+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8bd9ee9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BD9EC8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF664FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BDABA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BDA99C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BDA6A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BDA48D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BDA270000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BD9EC8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BDADA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8bd9ee9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:30:48.193+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:31:47.578+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] MongoDB starting : pid=1069 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:31:47.586+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:31:47.637+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:31:47.927+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829507:927719][1069:0x7f36a5577c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:31:47.927+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:31:47.947+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36a44a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36A4486000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF732FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F36A515E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F36A4F5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F36A4C60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36A4A4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36A482E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36A4486000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36A5367000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36a44a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:31:47.947+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:32:47.080+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] MongoDB starting : pid=1288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:32:47.087+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:32:47.088+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:32:47.143+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:32:47.424+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829567:424073][1288:0x7f5ca25eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:32:47.424+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:32:47.434+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ca151a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5CA14F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC58FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5CA21D1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5CA1FCD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5CA1CD3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5CA1ABE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5CA18A1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5CA14F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5CA23DA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ca151a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:32:47.434+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:33:47.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=1438 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:33:47.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:33:47.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:33:47.897+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829627:897848][1438:0x7f2204400c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:33:47.897+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:33:47.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2203330635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F220330F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40148000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2203FE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2203DE3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2203AE9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22038D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22036B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F220330F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22041F0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2203330635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:33:47.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:34:47.627+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] MongoDB starting : pid=1691 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:34:47.634+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:34:47.684+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:34:47.921+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829687:921703][1691:0x7f2d45709c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:34:47.921+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:34:47.932+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d44639635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D44618000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDDC3D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D452F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D450EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D44DF2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D44BDD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D449C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D44618000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D454F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d44639635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:34:47.932+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:35:47.066+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=1902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:35:47.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:35:47.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:35:47.402+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829747:402899][1902:0x7f6169fb9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:35:47.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:35:47.413+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6168ee9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6168EC8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFBC77000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6169BA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F616999C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61696A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F616948D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6169270000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6168EC8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6169DA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6168ee9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:35:47.413+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:36:47.818+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:36:47.825+0000 I CONTROL [initandlisten] MongoDB starting : pid=2111 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:36:47.825+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:36:47.826+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:36:47.877+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:36:48.154+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829808:154723][2111:0x7f2379c30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:36:48.154+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:36:48.165+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2378b60635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2378B3F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2379817000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2379613000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2379319000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2379104000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2378EE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2378B3F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2379A20000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2378b60635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:36:48.165+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:37:47.295+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] MongoDB starting : pid=2332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:37:47.302+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:37:47.352+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:37:47.721+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829867:721361][2332:0x7f2fc635dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:37:47.721+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:37:47.741+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2fc528d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FC526C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43002000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FC5F44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FC5D40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FC5A46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FC5831000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FC5614000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FC526C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FC614D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2fc528d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:37:47.741+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:38:47.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] MongoDB starting : pid=2489 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:38:47.882+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:38:47.932+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:38:48.269+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829928:269586][2489:0x7f74d8aa5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:38:48.269+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:38:48.289+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74d79d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74D79B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93463000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74D868C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74D8488000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74D818E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F74D7F79000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F74D7D5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74D79B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74D8895000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74d79d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:38:48.289+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:39:47.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] MongoDB starting : pid=2752 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:39:47.438+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:39:47.490+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:39:47.848+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507829987:848757][2752:0x7fb4161dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:39:47.848+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:39:47.864+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb41510b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB4150EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF28E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB415DC2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB415BBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB4158C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB4156AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB415492000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB4150EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB415FCB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb41510b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:39:47.864+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:40:47.997+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] MongoDB starting : pid=2968 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:40:48.005+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:40:48.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:40:48.304+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830048:304642][2968:0x7f28cda2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:40:48.304+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:40:48.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28cc95e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28CC93D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE50FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28CD615000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28CD411000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28CD117000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F28CCF02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28CCCE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28CC93D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28CD81E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28cc95e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:40:48.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:41:47.774+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:41:47.781+0000 I CONTROL [initandlisten] MongoDB starting : pid=3181 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:41:47.781+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:41:47.781+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:41:47.781+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:41:47.782+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:41:47.782+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:41:47.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:41:47.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:41:47.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:41:47.834+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:41:48.138+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830108:138887][3181:0x7f496aa4ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:41:48.138+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:41:48.149+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f496997a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4969959000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF976FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F496A631000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F496A42D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F496A133000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4969F1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4969D01000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4969959000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F496A83A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f496997a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:41:48.149+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:42:47.282+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] MongoDB starting : pid=3405 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:42:47.289+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:42:47.339+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:42:47.637+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830167:637174][3405:0x7f835afcec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:42:47.637+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:42:47.647+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8359efe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8359EDD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0C269000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F835ABB5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F835A9B1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F835A6B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F835A4A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F835A285000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8359EDD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F835ADBE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8359efe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:42:47.647+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:43:47.768+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=3589 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:43:47.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:43:47.825+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:43:48.145+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830228:145461][3589:0x7fb37d54cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:43:48.145+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:43:48.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb37c47c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB37C45B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB322C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB37D133000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB37CF2F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB37CC35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB37CA20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB37C803000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB37C45B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB37D33C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb37c47c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:43:48.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:44:47.807+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=3842 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:44:47.814+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:44:47.866+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:44:48.206+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830288:206905][3842:0x7f0171022c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:44:48.206+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:44:48.217+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f016ff52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F016FF31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB925B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0170C09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0170A05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F017070B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01704F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01702D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F016FF31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0170E12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f016ff52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:44:48.217+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:45:47.348+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] MongoDB starting : pid=4050 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:45:47.355+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:45:47.407+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:45:47.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830347:787153][4050:0x7fde0ec11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:45:47.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:45:47.807+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde0db41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE0DB20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF81EA6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE0E7F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE0E5F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE0E2FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE0E0E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE0DEC8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE0DB20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE0EA01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde0db41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:45:47.807+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:46:47.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=4255 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:46:47.217+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:46:47.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:46:47.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:46:47.655+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830407:655451][4255:0x7f0a427d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:46:47.655+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:46:47.675+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a41706635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A416E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB66DE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A423BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A421B9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A41EBF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A41CAA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A41A8D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A416E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A425C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a41706635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:46:47.675+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:47:47.797+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] MongoDB starting : pid=4477 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:47:47.804+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:47:47.854+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:47:48.188+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830468:188762][4477:0x7f53abd7cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:47:48.188+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:47:48.208+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53aacac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53AAC8B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53AB963000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53AB75F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53AB465000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F53AB250000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F53AB033000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53AAC8B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53ABB6C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53aacac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:47:48.208+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:48:47.343+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] MongoDB starting : pid=4635 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:48:47.350+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:48:47.401+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:48:47.682+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830527:682765][4635:0x7f7e362bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:48:47.682+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:48:47.693+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e351ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E351C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF785E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E35EA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E35C9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E359A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E3578E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E35571000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E351C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E360AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e351ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:48:47.693+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:49:47.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] MongoDB starting : pid=4901 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:49:47.189+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:49:47.238+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:49:47.523+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830587:523200][4901:0x7f340e9a6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:49:47.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:49:47.533+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f340d8d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F340D8B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDAAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F340E58D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F340E389000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F340E08F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F340DE7A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F340DC5D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F340D8B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F340E796000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f340d8d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:49:47.533+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:50:47.677+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] MongoDB starting : pid=5337 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:50:47.684+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:50:47.733+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:50:48.072+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830648:72802][5337:0x7f8c0a41bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:50:48.072+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:50:48.096+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8c0934b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8C0932A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF526FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8C0A002000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8C09DFE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8C09B04000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8C098EF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8C096D2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8C0932A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8C0A20B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8c0934b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:50:48.096+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:51:47.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] MongoDB starting : pid=5670 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:51:47.475+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:51:47.526+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:51:47.850+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830707:850118][5670:0x7fd25b595c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:51:47.850+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:51:47.860+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd25a4c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD25A4A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD25B17C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD25AF78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD25AC7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD25AA69000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD25A84C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD25A4A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD25B385000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd25a4c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:51:47.860+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:52:47.983+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] MongoDB starting : pid=6053 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:52:47.990+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:52:48.041+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:52:48.335+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830768:335912][6053:0x7f0ea0fddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:52:48.335+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:52:48.346+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e9ff0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E9FEEC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8447A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EA0BC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EA09C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EA06C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EA04B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EA0294000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E9FEEC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EA0DCD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e9ff0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:52:48.346+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:53:47.467+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] MongoDB starting : pid=6283 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:53:47.475+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:53:47.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:53:47.917+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830827:917012][6283:0x7fe8b1b26c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:53:47.917+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:53:47.936+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe8b0a56635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE8B0A35000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B1B1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE8B170D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE8B1509000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE8B120F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE8B0FFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE8B0DDD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE8B0A35000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE8B1916000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe8b0a56635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:53:47.936+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:54:47.460+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] MongoDB starting : pid=6621 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:54:47.468+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:54:47.518+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:54:47.888+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830887:888739][6621:0x7f18ccb17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:54:47.888+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:54:47.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18cba47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18CBA26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE449000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18CC6FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18CC4FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18CC200000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18CBFEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18CBDCE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18CBA26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18CC907000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18cba47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:54:47.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:55:48.028+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] MongoDB starting : pid=6862 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:55:48.035+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:55:48.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:55:48.392+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507830948:392332][6862:0x7fc276c4cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:55:48.392+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:55:48.403+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc275b7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC275B5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEDA4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC276833000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC27662F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC276335000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC276120000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC275F03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC275B5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC276A3C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc275b7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:55:48.403+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:56:47.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] MongoDB starting : pid=7078 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:56:47.902+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:56:47.952+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:56:48.211+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831008:211113][7078:0x7fcf8efddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:56:48.211+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:56:48.221+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf8df0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF8DEEC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9FF7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF8EBC4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF8E9C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF8E6C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF8E4B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF8E294000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF8DEEC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF8EDCD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf8df0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:56:48.221+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:57:47.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=7309 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:57:47.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:57:47.396+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:57:47.770+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831067:770389][7309:0x7f203c4f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:57:47.770+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:57:47.790+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f203b426635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F203B405000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF912FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F203C0DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F203BED9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F203BBDF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F203B9CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F203B7AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F203B405000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F203C2E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f203b426635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:57:47.790+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:58:47.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=7469 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:58:47.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:58:47.984+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:58:48.333+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831128:333838][7469:0x7f0448bbbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:58:48.333+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:58:48.344+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0447aeb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0447ACA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04487A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F044859E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04482A4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F044808F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0447E72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0447ACA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04489AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0447aeb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:58:48.344+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T17:59:47.488+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] MongoDB starting : pid=7720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] modules: none 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] build environment: 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T17:59:47.495+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T17:59:47.545+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T17:59:47.883+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831187:883049][7720:0x7fe0462afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T17:59:47.883+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T17:59:47.895+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0451df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0451BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF742FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE045E96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE045C92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE045998000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE045783000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE045566000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0451BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE04609F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0451df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T17:59:47.895+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:00:47.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=7983 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:00:47.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:00:47.233+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:00:47.594+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831247:594300][7983:0x7f1614c91c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:00:47.594+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:00:47.614+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1613bc1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1613BA0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF938FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1614878000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1614674000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F161437A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1614165000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1613F48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1613BA0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1614A81000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1613bc1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:00:47.614+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:01:47.991+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=8188 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:01:47.998+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:01:48.048+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:01:48.359+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831308:359067][8188:0x7ffdde73dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:01:48.359+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:01:48.379+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffddd66d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFDDD64C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF70FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFDDE324000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFDDE120000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFDDDE26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFDDDC11000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFDDD9F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFDDD64C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFDDE52D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffddd66d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:01:48.379+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:02:47.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=8357 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:02:47.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:02:47.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:02:48.283+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831368:283820][8357:0x7f727f70cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:02:48.283+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:02:48.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f727e63c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F727E61B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF218FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F727F2F3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F727F0EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F727EDF5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F727EBE0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F727E9C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F727E61B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F727F4FC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f727e63c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:02:48.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:03:47.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] MongoDB starting : pid=8573 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:03:47.438+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:03:47.489+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:03:47.870+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831427:870817][8573:0x7f6abfbe7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:03:47.870+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:03:47.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6abeb17635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6ABEAF6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFEC12000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6ABF7CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6ABF5CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6ABF2D0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6ABF0BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6ABEE9E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6ABEAF6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6ABF9D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6abeb17635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:03:47.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:04:47.698+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] MongoDB starting : pid=8690 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:04:47.702+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:04:47.703+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:04:47.703+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:04:47.730+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:04:48.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831488:52911][8690:0x7f3ad2565c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:04:48.053+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:04:48.072+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3ad1495635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3AD1474000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4BA6B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3AD214C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3AD1F48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3AD1C4E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3AD1A39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3AD181C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3AD1474000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3AD2355000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3ad1495635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:04:48.072+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:05:47.191+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] MongoDB starting : pid=8957 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:05:47.199+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:05:47.249+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:05:47.546+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831547:546481][8957:0x7fcd9c661c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:05:47.546+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:05:47.557+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd9b591635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD9B570000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD9C248000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD9C044000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD9BD4A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD9BB35000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD9B918000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD9B570000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD9C451000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd9b591635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:05:47.557+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:06:47.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=9163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:06:47.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:06:47.980+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:06:48.030+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:06:48.337+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831608:337809][9163:0x7f55615a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:06:48.337+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:06:48.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55604d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F55604B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82CBA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5561188000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5560F84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5560C8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5560A75000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5560858000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F55604B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5561391000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55604d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:06:48.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:07:47.475+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] MongoDB starting : pid=9388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:07:47.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:07:47.533+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:07:47.931+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831667:931727][9388:0x7f3645220c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:07:47.931+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:07:47.950+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3644150635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F364412F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF96BD5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3644E07000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3644C03000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3644909000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F36446F4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F36444D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F364412F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3645010000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3644150635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:07:47.950+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:08:47.070+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] MongoDB starting : pid=9634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:08:47.077+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:08:47.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:08:47.484+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831727:484896][9634:0x7f1605740c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:08:47.485+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:08:47.510+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1604670635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F160464F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F7BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1605327000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1605123000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1604E29000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1604C14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F16049F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F160464F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1605530000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1604670635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:08:47.510+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:09:47.333+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] MongoDB starting : pid=9751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:09:47.340+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:09:47.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:09:47.777+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831787:777047][9751:0x7f21a03b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:09:47.777+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:09:47.796+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f219f2e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F219F2C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF098BC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F219FF9D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F219FD99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F219FA9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F219F88A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F219F66D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F219F2C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21A01A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f219f2e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:09:47.796+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:10:47.925+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] MongoDB starting : pid=10014 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:10:47.932+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:10:47.983+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:10:48.268+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831848:268779][10014:0x7f22bbaacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:10:48.268+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:10:48.279+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22ba9dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22BA9BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C808000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22BB693000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22BB48F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22BB195000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22BAF80000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22BAD63000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22BA9BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22BB89C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22ba9dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:10:48.279+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:11:47.746+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] MongoDB starting : pid=10219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:11:47.753+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:11:47.802+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:11:48.202+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831908:202231][10219:0x7f54e8fa7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:11:48.202+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:11:48.222+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54e7ed7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54E7EB6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC802000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54E8B8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54E898A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F54E8690000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54E847B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54E825E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54E7EB6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54E8D97000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54e7ed7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:11:48.222+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:12:47.359+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] MongoDB starting : pid=10523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:12:47.366+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:12:47.416+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:12:47.838+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507831967:838252][10523:0x7ff9e9bf8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:12:47.838+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:12:47.858+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9e8b28635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9E8B07000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF424FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF9E97DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9E95DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9E92E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9E90CC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF9E8EAF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9E8B07000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9E99E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9e8b28635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:12:47.858+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:13:47.992+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] MongoDB starting : pid=10773 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:13:47.999+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:13:48.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:13:48.330+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832028:330853][10773:0x7f299026cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:13:48.330+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:13:48.341+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f298f19c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F298F17B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF614FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F298FE53000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F298FC4F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F298F955000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F298F740000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F298F523000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F298F17B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F299005C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f298f19c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:13:48.341+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:14:47.474+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] MongoDB starting : pid=10891 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:14:47.481+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:14:47.530+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:14:47.863+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832087:863140][10891:0x7fc7f9da0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:14:47.863+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:14:47.874+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7f8cd0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7F8CAF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C471000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7F9987000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7F9783000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7F9489000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7F9274000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7F9057000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7F8CAF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7F9B90000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7f8cd0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:14:47.874+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:15:48.009+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:15:48.016+0000 I CONTROL [initandlisten] MongoDB starting : pid=11185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:15:48.017+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:15:48.066+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:15:48.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832148:459451][11185:0x7ff86cc14c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:15:48.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:15:48.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff86bb44635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF86BB23000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFEBAA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF86C7FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF86C5F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF86C2FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF86C0E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF86BECB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF86BB23000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF86CA04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff86bb44635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:15:48.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:16:47.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] MongoDB starting : pid=11398 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:16:47.873+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:16:47.923+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:16:48.200+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832208:200782][11398:0x7ffc6c38bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:16:48.200+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:16:48.211+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc6b2bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC6B29A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB30FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC6BF72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC6BD6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC6BA74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC6B85F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC6B642000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC6B29A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC6C17B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc6b2bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:16:48.211+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:17:47.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:17:47.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=11630 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:17:47.343+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:17:47.393+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:17:47.772+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832267:772686][11630:0x7fabf777fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:17:47.772+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:17:47.792+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabf66af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABF668E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2ECC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABF7366000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABF7162000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABF6E68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABF6C53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABF6A36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABF668E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABF756F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabf66af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:17:47.792+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:18:47.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] MongoDB starting : pid=11871 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:18:47.921+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:18:47.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:18:48.351+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832328:351465][11871:0x7fe7d608ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:18:48.351+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:18:48.362+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7d4fba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7D4F99000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DAA9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7D5C71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7D5A6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7D5773000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7D555E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7D5341000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7D4F99000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7D5E7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7d4fba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:18:48.362+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:19:47.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] MongoDB starting : pid=11986 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:19:47.493+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:19:47.544+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:19:47.930+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832387:930054][11986:0x7f2063f5ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:19:47.930+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:19:47.950+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2062e8a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2062E69000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF076F7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2063B41000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F206393D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2063643000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F206342E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2063211000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2062E69000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2063D4A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2062e8a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:19:47.950+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:20:47.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=12247 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:20:47.639+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:20:47.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:20:48.053+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832448:53688][12247:0x7f9e2651cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:20:48.053+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:20:48.072+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e2544c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E2542B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E26103000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E25EFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E25C05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E259F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E257D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E2542B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E2630C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e2544c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:20:48.072+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:21:47.527+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=12462 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:21:47.534+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:21:47.585+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:21:47.865+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832507:865656][12462:0x7f0614096c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:21:47.865+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:21:47.885+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0612fc6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0612FA5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C048000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0613C7D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0613A79000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F061377F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F061356A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F061334D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0612FA5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0613E86000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0612fc6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:21:47.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:22:48.007+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=12687 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:22:48.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:22:48.066+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:22:48.343+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832568:342994][12687:0x7f206f460c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:22:48.343+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:22:48.353+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f206e390635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F206E36F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F206F047000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F206EE43000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F206EB49000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F206E934000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F206E717000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F206E36F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F206F250000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f206e390635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:22:48.353+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:23:47.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=12923 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:23:47.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:23:47.541+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:23:47.881+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832627:881504][12923:0x7f8549ccbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:23:47.881+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:23:47.892+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8548bfb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8548BDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF792FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F85498B2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F85496AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F85493B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F854919F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8548F82000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8548BDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8549ABB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8548bfb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:23:47.892+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:24:48.007+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=13043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:24:48.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:24:48.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:24:48.427+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832688:427916][13043:0x7f3987123c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:24:48.428+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:24:48.447+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3986053635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3986032000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFACAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3986D0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3986B06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F398680C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39865F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39863DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3986032000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3986F13000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3986053635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:24:48.447+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:25:47.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=13298 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:25:47.782+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:25:47.832+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:25:48.200+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832748:200170][13298:0x7f2ea805fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:25:48.200+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:25:48.210+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ea6f8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2EA6F6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65EC9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2EA7C46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2EA7A42000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2EA7748000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2EA7533000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2EA7316000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2EA6F6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2EA7E4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ea6f8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:25:48.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:26:47.681+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=13515 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:26:47.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:26:47.749+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:26:48.055+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832808:55692][13515:0x7f429b431c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:26:48.055+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:26:48.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f429a361635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F429A340000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE6DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F429B018000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F429AE14000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F429AB1A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F429A905000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F429A6E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F429A340000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F429B221000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f429a361635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:26:48.066+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:27:47.191+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] MongoDB starting : pid=13732 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:27:47.199+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:27:47.248+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:27:47.572+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832867:572931][13732:0x7f571ed85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:27:47.573+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:27:47.584+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f571dcb5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F571DC94000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7385E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F571E96C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F571E768000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F571E46E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F571E259000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F571E03C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F571DC94000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F571EB75000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f571dcb5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:27:47.584+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:28:47.719+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=13978 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:28:47.726+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:28:47.776+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:28:48.145+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832928:145539][13978:0x7f6897376c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:28:48.145+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:28:48.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68962a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6896285000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE86FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6896F5D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6896D59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6896A5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F689684A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F689662D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6896285000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6897166000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68962a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:28:48.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:29:47.276+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] MongoDB starting : pid=14094 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:29:47.284+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:29:47.335+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:29:47.615+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507832987:615493][14094:0x7fbb7513ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:29:47.615+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:29:47.626+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb7406e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB7404D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF454FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB74D25000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB74B21000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB74827000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB74612000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB743F5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB7404D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB74F2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb7406e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:29:47.626+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:30:47.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] MongoDB starting : pid=14361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:30:47.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:30:48.005+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:30:48.356+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833048:356679][14361:0x7f2ed133fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:30:48.356+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:30:48.376+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ed026f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2ED024E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2ED0F26000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2ED0D22000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2ED0A28000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2ED0813000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2ED05F6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2ED024E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2ED112F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ed026f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:30:48.376+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:31:47.831+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] MongoDB starting : pid=14919 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:31:47.838+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:31:47.888+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:31:48.208+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833108:208260][14919:0x7f3e9ab6ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:31:48.208+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:31:48.218+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e99a9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E99A7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE8B3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E9A755000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E9A551000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E9A257000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E9A042000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E99E25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E99A7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E9A95E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e99a9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:31:48.218+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:32:47.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=15163 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:32:47.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:32:47.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:32:47.763+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833167:763408][15163:0x7f556e7b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:32:47.763+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:32:47.774+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f556d6e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F556D6C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C1B5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F556E3A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F556E19C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F556DEA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F556DC8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F556DA70000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F556D6C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F556E5A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f556d6e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:32:47.774+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:33:47.907+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] MongoDB starting : pid=15414 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:33:47.915+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:33:47.966+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:33:48.286+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833228:286101][15414:0x7f394e3cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:33:48.286+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:33:48.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f394d2ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F394D2DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF418D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F394DFB6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F394DDB2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F394DAB8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F394D8A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F394D686000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F394D2DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F394E1BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f394d2ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:33:48.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:34:47.413+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] MongoDB starting : pid=15531 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:34:47.421+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:34:47.472+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:34:47.747+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833287:747392][15531:0x7f0691c2dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:34:47.747+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:34:47.757+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0690b5d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0690B3C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CCDD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0691814000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0691610000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0691316000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0691101000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0690EE4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0690B3C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0691A1D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0690b5d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:34:47.758+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:35:47.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] MongoDB starting : pid=15789 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:35:47.417+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:35:47.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:35:47.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:35:47.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833347:828847][15789:0x7fbaa51d4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:35:47.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:35:47.848+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbaa4104635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAA40E3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCCAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAA4DBB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAA4BB7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAA48BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAA46A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAA448B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAA40E3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAA4FC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbaa4104635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:35:47.848+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:36:47.248+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] MongoDB starting : pid=16004 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:36:47.255+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:36:47.306+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:36:47.613+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833407:613689][16004:0x7fd6dd1d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:36:47.613+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:36:47.624+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd6dc100635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD6DC0DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF650FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD6DCDB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6DCBB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD6DC8B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD6DC6A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD6DC487000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD6DC0DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD6DCFC0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd6dc100635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:36:47.624+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:37:47.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=16184 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:37:47.758+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:37:47.809+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:37:48.102+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833468:102796][16184:0x7f743a76bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:37:48.102+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:37:48.113+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f743969b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F743967A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F743A352000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F743A14E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7439E54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7439C3F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7439A22000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F743967A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F743A55B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f743969b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:37:48.113+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:38:47.243+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:38:47.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=16369 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:38:47.252+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:38:47.302+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:38:47.648+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833527:648124][16369:0x7f1ae5b3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:38:47.648+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:38:47.670+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1ae4a6b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1AE4A4A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7498000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1AE5722000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1AE551E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1AE5224000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1AE500F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1AE4DF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1AE4A4A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1AE592B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1ae4a6b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:38:47.670+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:39:47.794+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] MongoDB starting : pid=16569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:39:47.801+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:39:47.852+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:39:48.117+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833588:117420][16569:0x7fc1463b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:39:48.117+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:39:48.127+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1452e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1452C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82637000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC145FA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC145D9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC145AA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC14588D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC145670000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1452C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1461A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1452e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:39:48.127+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:40:47.659+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:40:47.666+0000 I CONTROL [initandlisten] MongoDB starting : pid=16695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:40:47.667+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:40:47.717+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:40:47.983+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833647:983520][16695:0x7fc39b4e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:40:47.983+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:40:47.994+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc39a413635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC39A3F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E746000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC39B0CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC39AEC6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC39ABCC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC39A9B7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC39A79A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC39A3F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC39B2D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc39a413635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:40:47.994+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:41:47.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] MongoDB starting : pid=16975 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:41:47.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:41:47.508+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:41:47.906+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833707:906063][16975:0x7fac40148c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:41:47.906+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:41:47.925+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac3f078635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC3F057000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2D3CF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC3FD2F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC3FB2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC3F831000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC3F61C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC3F3FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC3F057000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC3FF38000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac3f078635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:41:47.925+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:42:48.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:42:48.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=17198 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:42:48.049+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:42:48.049+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:42:48.049+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:42:48.049+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:42:48.049+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:42:48.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:42:48.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:42:48.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:42:48.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:42:48.471+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833768:471721][17198:0x7f6d76384c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:42:48.471+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:42:48.491+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6d752b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6D75293000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6D75F6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6D75D67000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6D75A6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6D75858000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6D7563B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6D75293000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6D76174000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6d752b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:42:48.491+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:43:47.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] MongoDB starting : pid=17456 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:43:47.626+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:43:47.676+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:43:47.992+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833827:992017][17456:0x7f133f8d1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:43:47.992+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:43:48.002+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f133e801635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F133E7E0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F133F4B8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F133F2B4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F133EFBA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F133EDA5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F133EB88000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F133E7E0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F133F6C1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f133e801635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:43:48.002+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:44:47.129+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=17661 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:44:47.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:44:47.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:44:47.476+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833887:476805][17661:0x7f84949c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:44:47.476+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:44:47.487+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f84938f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F84938D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA48FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84945AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84943A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84940AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8493E97000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8493C7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F84938D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F84947B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f84938f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:44:47.487+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:45:47.816+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] MongoDB starting : pid=17777 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:45:47.823+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:45:47.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:45:48.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507833948:152177][17777:0x7f5f70adfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:45:48.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:45:48.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5f6fa0f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5F6F9EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31390000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5F706C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5F704C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5F701C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5F6FFB3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5F6FD96000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5F6F9EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5F708CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5f6fa0f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:45:48.162+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:46:47.528+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] MongoDB starting : pid=18044 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:46:47.536+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:46:47.587+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:46:47.947+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834007:947402][18044:0x7f45b9534c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:46:47.947+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:46:47.966+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45b8464635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45B8443000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD04A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45B911B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45B8F17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45B8C1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F45B8A08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F45B87EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45B8443000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45B9324000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45b8464635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:46:47.966+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:47:47.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] MongoDB starting : pid=18263 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:47:47.106+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:47:47.156+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:47:47.476+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834067:476478][18263:0x7f56c11d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:47:47.476+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:47:47.488+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56c0100635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56C00DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56C0DB7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56C0BB3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56C08B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56C06A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56C0487000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56C00DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56C0FC0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56c0100635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:47:47.488+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:48:47.615+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] MongoDB starting : pid=18500 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:48:47.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:48:47.672+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:48:48.026+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834128:26497][18500:0x7fe79b7cbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:48:48.026+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:48:48.046+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe79a6fb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE79A6DA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF55E65000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE79B3B2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE79B1AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE79AEB4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE79AC9F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE79AA82000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE79A6DA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE79B5BB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe79a6fb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:48:48.046+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:49:47.161+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] MongoDB starting : pid=18754 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:49:47.168+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:49:47.218+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:49:47.482+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834187:482271][18754:0x7f0d7c905c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:49:47.482+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:49:47.503+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d7b835635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D7B814000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFADCED000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D7C4EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D7C2E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D7BFEE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D7BDD9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D7BBBC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D7B814000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D7C6F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d7b835635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:49:47.503+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:50:48.033+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=19098 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:50:48.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:50:48.068+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:50:48.319+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834248:319667][19098:0x7f0e4b7a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:50:48.319+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:50:48.330+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e4a6d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E4A6AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4396C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E4B387000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E4B183000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E4AE89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E4AC74000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E4AA57000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E4A6AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E4B590000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e4a6d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:50:48.330+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:51:47.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=19406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:51:47.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:51:47.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:51:48.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834308:153935][19406:0x7facfc829c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:51:48.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:51:48.164+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7facfb759635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FACFB738000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "800000457000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FACFC410000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FACFC20C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FACFBF12000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FACFBCFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FACFBAE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FACFB738000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FACFC619000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7facfb759635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:51:48.164+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:52:47.285+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] MongoDB starting : pid=19627 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:52:47.293+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:52:47.342+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:52:47.711+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834367:711109][19627:0x7fc95e011c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:52:47.711+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:52:47.730+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc95cf41635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC95CF20000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF256FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC95DBF8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC95D9F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC95D6FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC95D4E5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC95D2C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC95CF20000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC95DE01000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc95cf41635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:52:47.730+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:53:47.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] MongoDB starting : pid=19859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:53:47.871+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:53:47.922+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:53:48.263+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834428:263941][19859:0x7f31f62a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:53:48.264+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:53:48.283+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f31f51d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F31F51B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F31F5E89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F31F5C85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F31F598B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F31F5776000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F31F5559000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F31F51B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F31F6092000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f31f51d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:53:48.283+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:54:47.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] MongoDB starting : pid=20079 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:54:47.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:54:47.475+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:54:47.853+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834487:853233][20079:0x7fc9d7f8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:54:47.853+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:54:47.872+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9d6ebd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9D6E9C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8478E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9D7B74000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9D7970000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9D7676000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9D7461000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9D7244000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9D6E9C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9D7D7D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9d6ebd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:54:47.872+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:55:47.134+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] MongoDB starting : pid=20219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:55:47.142+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:55:47.191+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:55:47.485+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834547:485212][20219:0x7ffb55239c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:55:47.485+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:55:47.495+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb54169635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB54148000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF606C8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB54E20000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB54C1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB54922000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB5470D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB544F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB54148000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB55029000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb54169635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:55:47.495+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:56:47.992+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] MongoDB starting : pid=20519 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:56:47.999+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:56:48.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:56:48.349+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834608:349816][20519:0x7feef2fc4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:56:48.349+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:56:48.361+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feef1ef4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEEF1ED3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEEF2BAB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEEF29A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEEF26AD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEEF2498000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEEF227B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEEF1ED3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEEF2DB4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feef1ef4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:56:48.361+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:57:47.488+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] MongoDB starting : pid=20738 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:57:47.501+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:57:47.551+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:57:47.858+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834667:858930][20738:0x7f7bc56a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:57:47.858+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:57:47.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7bc45d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7BC45B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA08FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7BC5290000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7BC508C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7BC4D92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7BC4B7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7BC4960000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7BC45B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7BC5499000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7bc45d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:57:47.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:58:47.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=20993 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:58:48.001+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:58:48.051+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:58:48.350+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834728:350313][20993:0x7fecebfb0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:58:48.350+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:58:48.363+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feceaee0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECEAEBF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEA8E2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECEBB97000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECEB993000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECEB699000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECEB484000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECEB267000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECEAEBF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FECEBDA0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feceaee0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:58:48.364+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T18:59:47.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] MongoDB starting : pid=21212 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] modules: none 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] build environment: 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T18:59:47.497+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T18:59:47.547+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T18:59:47.796+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834787:796811][21212:0x7f54a5593c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T18:59:47.796+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T18:59:47.807+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54a44c3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54A44A2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54A517A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54A4F76000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F54A4C7C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54A4A67000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54A484A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54A44A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54A5383000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54a44c3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T18:59:47.807+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:00:47.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=21361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:00:47.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:00:47.540+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:00:47.817+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834847:817874][21361:0x7f96545aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:00:47.817+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:00:47.828+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96534da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96534B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF590FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9654191000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9653F8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9653C93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9653A7E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9653861000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96534B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F965439A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96534da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:00:47.828+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:01:47.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:01:47.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=21652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:01:47.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:01:47.261+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:01:47.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834907:668941][21652:0x7f69c76a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:01:47.669+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:01:47.688+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f69c65d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F69C65B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13E6E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F69C728E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F69C708A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F69C6D90000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F69C6B7B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F69C695E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F69C65B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F69C7497000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f69c65d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:01:47.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:02:47.428+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] MongoDB starting : pid=21894 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:02:47.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:02:47.488+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:02:47.857+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507834967:856981][21894:0x7ffd4b098c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:02:47.857+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:02:47.876+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd49fc8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD49FA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF554FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD4AC7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD4AA7B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD4A781000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD4A56C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD4A34F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD49FA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD4AE88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd49fc8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:02:47.876+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:03:48.009+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] MongoDB starting : pid=22105 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:03:48.017+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:03:48.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:03:48.452+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835028:452238][22105:0x7f5bac02ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:03:48.452+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:03:48.472+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5baaf5a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5BAAF39000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1158000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5BABC11000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5BABA0D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5BAB713000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5BAB4FE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5BAB2E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5BAAF39000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5BABE1A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5baaf5a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:03:48.472+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:04:47.608+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] MongoDB starting : pid=22333 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:04:47.615+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:04:47.665+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:04:48.009+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835088:9691][22333:0x7fde06161c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:04:48.009+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:04:48.028+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde05091635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE05070000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF402FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE05D48000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE05B44000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE0584A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE05635000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE05418000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE05070000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE05F51000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde05091635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:04:48.029+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:05:47.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:05:47.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=22470 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:05:47.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:05:47.808+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:05:48.133+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835148:133605][22470:0x7f1290a37c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:05:48.133+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:05:48.144+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f128f967635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F128F946000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F129061E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F129041A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1290120000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F128FF0B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F128FCEE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F128F946000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1290827000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f128f967635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:05:48.144+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:06:47.538+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] MongoDB starting : pid=22761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:06:47.546+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:06:47.596+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:06:47.979+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835207:979525][22761:0x7f7495ebcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:06:47.979+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:06:47.999+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7494dec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7494DCB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF47CAA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7495AA3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F749589F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74955A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7495390000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7495173000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7494DCB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7495CAC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7494dec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:06:47.999+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:07:47.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=22982 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:07:47.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:07:47.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:07:47.605+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835267:605130][22982:0x7f2c410e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:07:47.605+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:07:47.626+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c40014635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C3FFF3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDE666000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C40CCB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C40AC7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C407CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C405B8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C4039B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C3FFF3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C40ED4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c40014635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:07:47.626+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:08:47.745+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] MongoDB starting : pid=23201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:08:47.753+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:08:47.803+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:08:48.158+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835328:158339][23201:0x7faffd058c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:08:48.158+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:08:48.169+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faffbf88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAFFBF67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAFFCC3F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAFFCA3B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAFFC741000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAFFC52C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAFFC30F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAFFBF67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAFFCE48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faffbf88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:08:48.169+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:09:47.300+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] MongoDB starting : pid=23427 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:09:47.307+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:09:47.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:09:47.763+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835387:763090][23427:0x7f42485f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:09:47.763+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:09:47.782+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4247527635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4247506000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58ED6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F42481DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4247FDA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4247CE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4247ACB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F42478AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4247506000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F42483E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4247527635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:09:47.782+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:10:47.971+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] MongoDB starting : pid=23567 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:10:47.978+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:10:48.031+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:10:48.379+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835448:379793][23567:0x7fe1b1098c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:10:48.379+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:10:48.393+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1affc8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1AFFA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB25C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1B0C7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1B0A7B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1B0781000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1B056C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1B034F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1AFFA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1B0E88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1affc8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:10:48.393+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:11:47.810+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=23865 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:11:47.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:11:47.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:11:48.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835508:276545][23865:0x7fcdb9c33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:11:48.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:11:48.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcdb8b63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCDB8B42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE76FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCDB981A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCDB9616000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCDB931C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCDB9107000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCDB8EEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCDB8B42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCDB9A23000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcdb8b63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:11:48.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:12:47.427+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:12:47.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=24047 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:12:47.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:12:47.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:12:47.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835567:911337][24047:0x7ffd45c3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:12:47.911+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:12:47.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd44b6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD44B4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9BD3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD45825000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD45621000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD45327000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD45112000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD44EF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD44B4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD45A2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd44b6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:12:47.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:13:47.050+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] MongoDB starting : pid=24212 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:13:47.057+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:13:47.106+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:13:47.464+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835627:464247][24212:0x7ff846817c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:13:47.464+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:13:47.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff845747635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF845726000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAB6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8463FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8461FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF845F00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF845CEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF845ACE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF845726000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF846607000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff845747635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:13:47.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:14:47.615+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] MongoDB starting : pid=24447 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:14:47.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:14:47.673+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:14:47.984+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835687:984446][24447:0x7f25c008fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:14:47.984+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:14:47.996+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25befbf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25BEF9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF6A55000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25BFC76000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F25BFA72000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25BF778000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25BF563000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25BF346000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25BEF9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25BFE7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25befbf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:14:47.996+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:15:47.124+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] MongoDB starting : pid=24664 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:15:47.132+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:15:47.184+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:15:47.521+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835747:521249][24664:0x7f1ca8addc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:15:47.521+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:15:47.532+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1ca7a0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CA79EC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5804000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CA86C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CA84C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CA81C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CA7FB1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CA7D94000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CA79EC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CA88CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1ca7a0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:15:47.532+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:16:47.930+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:16:47.937+0000 I CONTROL [initandlisten] MongoDB starting : pid=24822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:16:47.938+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:16:47.987+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:16:48.285+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835808:285563][24822:0x7f623418bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:16:48.285+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:16:48.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62330bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F623309A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6233D72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6233B6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6233874000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F623365F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6233442000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F623309A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6233F7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62330bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:16:48.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:17:47.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] MongoDB starting : pid=25099 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:17:47.437+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:17:47.487+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:17:47.771+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835867:771418][25099:0x7f907bca6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:17:47.771+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:17:47.781+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f907abd6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F907ABB5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F907B88D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F907B689000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F907B38F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F907B17A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F907AF5D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F907ABB5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F907BA96000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f907abd6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:17:47.781+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:18:47.911+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=25312 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:18:47.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:18:47.976+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:18:48.289+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835928:289105][25312:0x7f8e723a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:18:48.289+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:18:48.308+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e712d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E712B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2DCEE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E71F8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E71D88000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E71A8E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E71879000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E7165C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E712B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E72195000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e712d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:18:48.308+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:19:47.434+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] MongoDB starting : pid=25542 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:19:47.442+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:19:47.492+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:19:47.883+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507835987:883093][25542:0x7fd5c1d74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:19:47.883+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:19:47.902+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5c0ca4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5C0C83000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C792000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD5C195B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5C1757000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5C145D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5C1248000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5C102B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5C0C83000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5C1B64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5c0ca4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:19:47.902+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:20:47.671+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=25761 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:20:47.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:20:47.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:20:48.076+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836048:76352][25761:0x7f1f4019ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:20:48.076+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:20:48.095+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f3f0ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F3F0AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F3FD85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F3FB81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F3F887000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F3F672000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F3F455000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F3F0AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F3FF8E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f3f0ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:20:48.095+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:21:47.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] MongoDB starting : pid=25917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:21:47.475+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:21:47.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:21:47.900+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836107:900396][25917:0x7f29d07e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:21:47.900+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:21:47.916+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29cf719635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29CF6F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29D03D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29D01CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29CFED2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29CFCBD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29CFAA0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29CF6F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29D05D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29cf719635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:21:47.916+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:22:48.049+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] MongoDB starting : pid=26202 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:22:48.056+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:22:48.106+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:22:48.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836168:490408][26202:0x7f631dc28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:22:48.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:22:48.510+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f631cb58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F631CB37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28619000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F631D80F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F631D60B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F631D311000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F631D0FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F631CEDF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F631CB37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F631DA18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f631cb58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:22:48.510+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:23:47.644+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] MongoDB starting : pid=26407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:23:47.651+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:23:47.701+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:23:48.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836228:19320][26407:0x7ff24ea7cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:23:48.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:23:48.030+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff24d9ac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF24D98B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B0D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF24E663000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF24E45F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF24E165000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF24DF50000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF24DD33000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF24D98B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF24E86C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff24d9ac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:23:48.030+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:24:47.147+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] MongoDB starting : pid=26636 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:24:47.155+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:24:47.209+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:24:47.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836287:556231][26636:0x7f20a7d4bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:24:47.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:24:47.567+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f20a6c7b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F20A6C5A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF588FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F20A7932000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F20A772E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20A7434000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F20A721F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F20A7002000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F20A6C5A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F20A7B3B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f20a6c7b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:24:47.567+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:25:47.103+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] MongoDB starting : pid=26849 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:25:47.111+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:25:47.163+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:25:47.550+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836347:550167][26849:0x7f5acbb9ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:25:47.550+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:25:47.570+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5acaaca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5ACAAA9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5ACB781000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5ACB57D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5ACB283000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5ACB06E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5ACAE51000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5ACAAA9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5ACB98A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5acaaca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:25:47.570+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:26:48.041+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=27015 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:26:48.049+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:26:48.098+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:26:48.482+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836408:482221][27015:0x7f56a24f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:26:48.482+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:26:48.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56a1429635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56A1408000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000004FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56A20E0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56A1EDC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56A1BE2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56A19CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56A17B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56A1408000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56A22E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56a1429635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:26:48.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:27:47.613+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] MongoDB starting : pid=27280 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:27:47.617+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:27:47.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:27:48.021+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836468:21692][27280:0x7f22eafe9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:27:48.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:27:48.042+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22e9f19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22E9EF8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22EABD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22EA9CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22EA6D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22EA4BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22EA2A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22E9EF8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22EADD9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22e9f19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:27:48.042+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:28:47.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:28:47.182+0000 I CONTROL [initandlisten] MongoDB starting : pid=27504 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:28:47.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:28:47.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:28:47.535+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836527:535347][27504:0x7fef8b3a4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:28:47.535+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:28:47.555+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef8a2d4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF8A2B3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA32FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF8AF8B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF8AD87000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF8AA8D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF8A878000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF8A65B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF8A2B3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF8B194000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef8a2d4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:28:47.555+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:29:47.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] MongoDB starting : pid=27731 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:29:47.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:29:47.744+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:29:48.037+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836588:37195][27731:0x7fb161848c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:29:48.037+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:29:48.047+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb160778635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB160757000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF154FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB16142F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB16122B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB160F31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB160D1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB160AFF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB160757000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB161638000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb160778635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:29:48.047+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:30:47.475+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] MongoDB starting : pid=27955 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:30:47.482+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:30:47.535+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:30:47.932+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836647:932235][27955:0x7f4eb3de9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:30:47.932+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:30:47.953+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4eb2d19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4EB2CF8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC950C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4EB39D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4EB37CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4EB34D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4EB32BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4EB30A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4EB2CF8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4EB3BD9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4eb2d19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:30:47.953+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:31:47.467+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] MongoDB starting : pid=28116 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:31:47.474+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:31:47.524+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:31:47.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836707:841364][28116:0x7f4291756c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:31:47.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:31:47.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4290686635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4290665000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF33679000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F429133D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4291139000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4290E3F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4290C2A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4290A0D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4290665000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4291546000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4290686635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:31:47.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:32:47.978+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] MongoDB starting : pid=28375 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:32:47.985+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:32:48.037+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:32:48.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836768:408608][28375:0x7fc11d4f4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:32:48.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:32:48.429+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc11c424635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC11C403000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEAAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC11D0DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC11CED7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC11CBDD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC11C9C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC11C7AB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC11C403000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC11D2E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc11c424635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:32:48.429+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:33:47.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] MongoDB starting : pid=28594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:33:47.557+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:33:47.606+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:33:47.898+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836827:898962][28594:0x7f0c9b046c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:33:47.899+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:33:47.919+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c99f76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C99F55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF264FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C9AC2D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C9AA29000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C9A72F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C9A51A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C9A2FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C99F55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C9AE36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c99f76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:33:47.919+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:34:48.049+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] MongoDB starting : pid=28847 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:34:48.056+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:34:48.105+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:34:48.424+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836888:424160][28847:0x7f6b2c0b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:34:48.424+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:34:48.434+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b2afe5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B2AFC4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF27E03000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B2BC9C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B2BA98000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B2B79E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B2B589000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B2B36C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B2AFC4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B2BEA5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b2afe5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:34:48.435+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:35:47.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] MongoDB starting : pid=29055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:35:47.994+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:35:48.044+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:35:48.334+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507836948:334897][29055:0x7f715f338c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:35:48.334+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:35:48.345+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f715e268635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F715E247000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF712FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F715EF1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F715ED1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F715EA21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F715E80C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F715E5EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F715E247000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F715F128000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f715e268635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:35:48.345+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:36:47.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:36:47.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=29221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:36:47.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:36:47.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:36:47.848+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:36:48.099+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837008:99774][29221:0x7f1b6522bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:36:48.099+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:36:48.110+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b6415b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B6413A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF462F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B64E12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B64C0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B64914000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B646FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B644E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B6413A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B6501B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b6415b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:36:48.110+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:37:47.248+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] MongoDB starting : pid=29468 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:37:47.256+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:37:47.306+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:37:47.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837067:670280][29468:0x7fdc7026dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:37:47.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:37:47.689+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc6f19d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC6F17C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC6FE54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC6FC50000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC6F956000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC6F741000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC6F524000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC6F17C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC7005D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc6f19d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:37:47.689+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:38:47.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=29698 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:38:47.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:38:47.881+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:38:48.201+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837128:201411][29698:0x7fd04c209c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:38:48.201+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:38:48.222+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd04b139635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD04B118000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92E7C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD04BDF0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD04BBEC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD04B8F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD04B6DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD04B4C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD04B118000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD04BFF9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd04b139635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:38:48.222+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:39:47.347+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] MongoDB starting : pid=29925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:39:47.354+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:39:47.404+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:39:47.765+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837187:765151][29925:0x7fb0c0ec2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:39:47.765+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:39:47.784+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0bfdf2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0BFDD1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0C0AA9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0C08A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0C05AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0C0396000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0C0179000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0BFDD1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0C0CB2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0bfdf2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:39:47.784+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:40:47.502+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:40:47.509+0000 I CONTROL [initandlisten] MongoDB starting : pid=30134 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:40:47.510+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:40:47.561+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:40:47.914+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837247:914214][30134:0x7f350eaa7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:40:47.914+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:40:47.933+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f350d9d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F350D9B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCA88000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F350E68E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F350E48A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F350E190000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F350DF7B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F350DD5E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F350D9B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F350E897000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f350d9d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:40:47.933+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:41:47.356+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] MongoDB starting : pid=30306 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:41:47.360+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:41:47.387+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:41:47.745+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837307:745310][30306:0x7f87ff3eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:41:47.745+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:41:47.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f87fe31e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87FE2FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8E90000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F87FEFD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F87FEDD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F87FEAD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F87FE8C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F87FE6A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87FE2FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87FF1DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f87fe31e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:41:47.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:42:47.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] MongoDB starting : pid=30559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:42:47.899+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:42:47.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:42:48.230+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837368:230081][30559:0x7f88bf7e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:42:48.230+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:42:48.249+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88be711635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88BE6F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF09066000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F88BF3C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88BF1C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88BEECA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88BECB5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88BEA98000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88BE6F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F88BF5D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88be711635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:42:48.249+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:43:47.386+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] MongoDB starting : pid=30800 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:43:47.393+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:43:47.394+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:43:47.443+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:43:47.839+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837427:839833][30800:0x7f3c2b766c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:43:47.839+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:43:47.859+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c2a696635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C2A675000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C2B34D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C2B149000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C2AE4F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C2AC3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C2AA1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C2A675000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C2B556000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c2a696635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:43:47.859+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:44:47.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] MongoDB starting : pid=31036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:44:47.999+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:44:48.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:44:48.353+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837488:353172][31036:0x7fd7619afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:44:48.353+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:44:48.363+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7608df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7608BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF595B6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD761596000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD761392000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD761098000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD760E83000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD760C66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7608BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD76179F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7608df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:44:48.363+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:45:47.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] MongoDB starting : pid=31247 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:45:47.490+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:45:47.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:45:47.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:45:47.540+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:45:47.832+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837547:832960][31247:0x7f71221f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:45:47.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:45:47.843+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7121126635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7121105000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF865D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7121DDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7121BD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71218DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71216CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71214AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7121105000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7121FE6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7121126635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:45:47.843+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:46:47.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:46:47.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=31412 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:46:47.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:46:47.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:46:47.529+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:46:47.871+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837607:871545][31412:0x7f2e42928c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:46:47.871+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:46:47.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e41858635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E41837000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3182000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E4250F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E4230B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E42011000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E41DFC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E41BDF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E41837000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E42718000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e41858635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:46:47.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:47:48.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=31681 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:47:48.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:47:48.089+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:47:48.467+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837668:467287][31681:0x7f90f4a3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:47:48.467+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:47:48.486+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90f396b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90F394A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90F4622000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90F441E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90F4124000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90F3F0F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90F3CF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90F394A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90F482B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90f396b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:47:48.486+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:48:47.607+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=31831 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:48:47.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:48:47.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:48:47.950+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837727:950315][31831:0x7fcee6022c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:48:47.950+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:48:47.960+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcee4f52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCEE4F31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB6CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCEE5C09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCEE5A05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCEE570B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCEE54F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCEE52D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCEE4F31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCEE5E12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcee4f52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:48:47.960+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:49:47.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] MongoDB starting : pid=32067 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:49:47.095+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:49:47.144+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:49:47.431+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837787:431238][32067:0x7fca88f8bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:49:47.431+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:49:47.442+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca87ebb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA87E9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DE19000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA88B72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA8896E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA88674000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA8845F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA88242000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA87E9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA88D7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca87ebb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:49:47.442+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:50:47.570+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=32283 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:50:47.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:50:47.627+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:50:47.935+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837847:935557][32283:0x7fca4a1b7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:50:47.935+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:50:47.947+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca490e7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA490C6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF354FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA49D9E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA49B9A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA498A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA4968B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA4946E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA490C6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA49FA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca490e7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:50:47.947+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:51:48.011+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] MongoDB starting : pid=32530 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:51:48.019+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:51:48.070+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:51:48.385+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837908:385924][32530:0x7f457438bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:51:48.385+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:51:48.396+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45732bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F457329A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4573F72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4573D6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4573A74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F457385F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4573642000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F457329A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F457417B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45732bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:51:48.396+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:52:47.514+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=32658 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:52:47.522+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:52:47.572+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:52:47.905+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507837967:905660][32658:0x7fc237ae5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:52:47.905+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:52:47.925+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc236a15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC2369F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF672FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC2376CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC2374C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC2371CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC236FB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC236D9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC2369F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC2378D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc236a15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:52:47.925+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:53:48.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] MongoDB starting : pid=477 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:53:48.063+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:53:48.113+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:53:48.369+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838028:369937][477:0x7fece93fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:53:48.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:53:48.380+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fece832c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECE830B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECE8FE3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECE8DDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECE8AE5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECE88D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECE86B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECE830B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FECE91EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fece832c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:53:48.380+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:54:47.506+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] MongoDB starting : pid=712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:54:47.514+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:54:47.564+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:54:47.896+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838087:896870][712:0x7f56700cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:54:47.896+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:54:47.907+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f566effa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F566EFD9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F566FCB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F566FAAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F566F7B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F566F59E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F566F381000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F566EFD9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F566FEBA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f566effa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:54:47.907+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:55:48.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:55:48.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:55:48.051+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:55:48.104+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:55:48.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838148:459207][917:0x7fa1d1722c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:55:48.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:55:48.469+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1d0652635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1D0631000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1D1309000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1D1105000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1D0E0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1D0BF6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1D09D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1D0631000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1D1512000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1d0652635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:55:48.469+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:56:47.722+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] MongoDB starting : pid=1161 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:56:47.730+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:56:47.779+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:56:48.075+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838208:75065][1161:0x7f74663b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:56:48.075+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:56:48.085+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74652e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74652C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC7E25000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7465F9C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7465D98000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7465A9E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7465889000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F746566C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74652C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74661A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74652e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:56:48.085+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:57:47.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=1286 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:57:47.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:57:47.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:57:47.584+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838267:584075][1286:0x7fcf3423dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:57:47.584+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:57:47.594+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf3316d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF3314C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98DC3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF33E24000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF33C20000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF33926000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF33711000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF334F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF3314C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF3402D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf3316d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:57:47.594+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:58:47.731+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] MongoDB starting : pid=1576 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:58:47.739+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:58:47.789+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:58:48.102+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838328:101993][1576:0x7f6bbf8ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:58:48.102+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:58:48.121+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6bbe81c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6BBE7FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF766FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6BBF4D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6BBF2CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6BBEFD5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6BBEDC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6BBEBA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6BBE7FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6BBF6DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6bbe81c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:58:48.121+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T19:59:47.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=1802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] modules: none 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] build environment: 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T19:59:47.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T19:59:47.316+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T19:59:47.695+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838387:695446][1802:0x7fead50c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T19:59:47.695+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T19:59:47.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fead3ff5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEAD3FD4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD66E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEAD4CAC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEAD4AA8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEAD47AE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEAD4599000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEAD437C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEAD3FD4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEAD4EB5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fead3ff5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T19:59:47.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:00:47.839+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] MongoDB starting : pid=2016 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:00:47.846+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:00:47.896+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:00:48.207+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838448:207860][2016:0x7f15d1677c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:00:48.207+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:00:48.218+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15d05a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15D0586000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15D125E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15D105A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15D0D60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15D0B4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15D092E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15D0586000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15D1467000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15d05a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:00:48.218+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:01:47.228+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] MongoDB starting : pid=2269 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:01:47.235+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:01:47.285+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:01:47.588+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838507:588861][2269:0x7fe4d1037c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:01:47.588+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:01:47.600+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4cff67635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4CFF46000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF558FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4D0C1E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4D0A1A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4D0720000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4D050B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4D02EE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4CFF46000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4D0E27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4cff67635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:01:47.600+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:02:47.405+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] MongoDB starting : pid=2409 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:02:47.413+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:02:47.464+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:02:47.749+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838567:749133][2409:0x7fa05cebac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:02:47.749+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:02:47.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa05bdea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA05BDC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF772E0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA05CAA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA05C89D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA05C5A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA05C38E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA05C171000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA05BDC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA05CCAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa05bdea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:02:47.760+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:03:47.889+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:03:47.896+0000 I CONTROL [initandlisten] MongoDB starting : pid=2693 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:03:47.896+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:03:47.896+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:03:47.896+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:03:47.896+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:03:47.897+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:03:47.897+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:03:47.897+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:03:47.897+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:03:47.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:03:48.229+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838628:229845][2693:0x7f0a34649c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:03:48.229+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:03:48.240+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a33579635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A33558000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF55866000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A34230000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A3402C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A33D32000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A33B1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A33900000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A33558000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A34439000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a33579635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:03:48.240+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:04:47.380+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] MongoDB starting : pid=2923 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:04:47.389+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:04:47.439+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:04:47.730+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838687:730191][2923:0x7f209a2d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:04:47.730+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:04:47.740+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2099202635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F20991E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2099EB9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2099CB5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F20999BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F20997A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2099589000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F20991E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F209A0C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2099202635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:04:47.740+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:05:47.858+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] MongoDB starting : pid=3126 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:05:47.866+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:05:47.918+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:05:48.277+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838748:277759][3126:0x7f7b4e9f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:05:48.277+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:05:48.297+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7b4d921635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7B4D900000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBCAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7B4E5D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7B4E3D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7B4E0DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7B4DEC5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7B4DCA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7B4D900000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7B4E7E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7b4d921635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:05:48.297+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:06:47.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=3389 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:06:47.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:06:47.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:06:47.544+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838807:544524][3389:0x7f0ae4dd6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:06:47.544+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:06:47.564+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ae3d06635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0AE3CE5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0AE49BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0AE47B9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0AE44BF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0AE42AA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0AE408D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0AE3CE5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0AE4BC6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ae3d06635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:06:47.564+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:07:47.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] MongoDB starting : pid=3526 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:07:47.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:07:47.745+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:07:48.071+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838868:71175][3526:0x7fa89f538c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:07:48.071+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:07:48.083+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa89e468635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA89E447000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7A96000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA89F11F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA89EF1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA89EC21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA89EA0C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA89E7EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA89E447000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA89F328000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa89e468635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:07:48.083+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:08:47.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:08:47.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=3821 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:08:47.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:08:47.256+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:08:47.576+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838927:576717][3821:0x7f240869ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:08:47.576+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:08:47.588+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24075ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24075A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E2CA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2408281000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F240807D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2407D83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2407B6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2407951000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24075A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F240848A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24075ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:08:47.588+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:09:47.719+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] MongoDB starting : pid=4058 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:09:47.727+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:09:47.777+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:09:48.097+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507838988:97520][4058:0x7f39e2ae3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:09:48.097+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:09:48.118+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39e1a13635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F39E19F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA34E2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39E26CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39E24C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39E21CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39E1FB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39E1D9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F39E19F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F39E28D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39e1a13635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:09:48.118+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:10:47.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] MongoDB starting : pid=4266 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:10:47.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:10:47.296+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:10:47.618+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839047:618746][4266:0x7fd66014ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:10:47.618+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:10:47.638+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd65f07e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD65F05D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD65FD35000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD65FB31000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD65F837000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD65F622000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD65F405000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD65F05D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD65FF3E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd65f07e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:10:47.638+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:11:47.327+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] MongoDB starting : pid=4521 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:11:47.334+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:11:47.384+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:11:47.735+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839107:735702][4521:0x7f09adee9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:11:47.735+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:11:47.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09ace19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09ACDF8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF34CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09ADAD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09AD8CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09AD5D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09AD3BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09AD1A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09ACDF8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09ADCD9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09ace19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:11:47.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:12:47.878+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:12:47.885+0000 I CONTROL [initandlisten] MongoDB starting : pid=4725 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:12:47.885+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:12:47.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:12:47.935+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:12:48.236+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839168:236682][4725:0x7fd7c3d34c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:12:48.236+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:12:48.256+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7c2c64635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7C2C43000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7C391B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7C3717000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7C341D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7C3208000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7C2FEB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7C2C43000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7C3B24000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7c2c64635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:12:48.256+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:13:47.381+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:13:47.388+0000 I CONTROL [initandlisten] MongoDB starting : pid=5240 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:13:47.389+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:13:47.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:13:47.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839227:782903][5240:0x7f4911b3bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:13:47.782+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:13:47.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4910a6b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4910A4A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79C36000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4911722000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F491151E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4911224000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F491100F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4910DF2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4910A4A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F491192B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4910a6b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:13:47.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:14:47.923+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] MongoDB starting : pid=5633 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:14:47.930+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:14:47.981+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:14:48.324+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839288:324467][5633:0x7fdcbe77ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:14:48.324+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:14:48.336+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdcbd6aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCBD689000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCBE361000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCBE15D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCBDE63000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCBDC4E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCBDA31000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCBD689000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCBE56A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdcbd6aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:14:48.336+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:15:47.459+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] MongoDB starting : pid=5959 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:15:47.467+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:15:47.517+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:15:47.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839347:775902][5959:0x7f2f930b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:15:47.775+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:15:47.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f91fe8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F91FC7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE08FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F92C9F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F92A9B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F927A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F9258C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F9236F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F91FC7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F92EA8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f91fe8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:15:47.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:16:48.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=6344 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:16:48.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:16:48.063+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:16:48.381+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839408:381164][6344:0x7f8239107c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:16:48.381+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:16:48.391+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8238037635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8238016000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8238CEE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8238AEA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F82387F0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F82385DB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F82383BE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8238016000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8238EF7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8238037635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:16:48.391+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:17:47.523+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] MongoDB starting : pid=6534 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:17:47.530+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:17:47.583+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:17:47.870+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839467:870015][6534:0x7ff767783c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:17:47.870+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:17:47.880+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff7666b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF766692000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF523F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF76736A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF767166000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF766E6C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF766C57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF766A3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF766692000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF767573000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff7666b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:17:47.880+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:18:48.016+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] MongoDB starting : pid=6846 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:18:48.024+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:18:48.075+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:18:48.389+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839528:389694][6846:0x7fa3f8f4fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:18:48.389+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:18:48.400+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa3f7e7f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3F7E5E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3F8B36000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3F8932000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3F8638000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3F8423000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3F8206000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3F7E5E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3F8D3F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa3f7e7f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:18:48.400+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:19:47.527+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=7072 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:19:47.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:19:47.535+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:19:47.535+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:19:47.586+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:19:47.874+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839587:874334][7072:0x7fa012187c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:19:47.874+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:19:47.893+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa0110b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA011096000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA011D6E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA011B6A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA011870000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA01165B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA01143E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA011096000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA011F77000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa0110b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:19:47.893+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:20:48.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] MongoDB starting : pid=7273 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:20:48.042+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:20:48.094+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:20:48.406+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839648:406299][7273:0x7fc11f2bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:20:48.406+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:20:48.417+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc11e1ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC11E1C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCDCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC11EEA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC11EC9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC11E9A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC11E78E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC11E571000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC11E1C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC11F0AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc11e1ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:20:48.417+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:21:47.263+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] MongoDB starting : pid=7523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:21:47.271+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:21:47.321+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:21:47.701+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839707:701545][7523:0x7ff73d472c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:21:47.701+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:21:47.721+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff73c3a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF73C381000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF908C3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF73D059000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF73CE55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF73CB5B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF73C946000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF73C729000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF73C381000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF73D262000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff73c3a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:21:47.721+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:22:47.844+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] MongoDB starting : pid=7648 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:22:47.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:22:47.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:22:48.255+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839768:255354][7648:0x7fc036c51c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:22:48.255+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:22:48.274+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc035b81635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC035B60000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAAAC8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC036838000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC036634000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC03633A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC036125000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC035F08000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC035B60000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC036A41000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc035b81635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:22:48.274+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:23:47.403+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] MongoDB starting : pid=7871 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:23:47.410+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:23:47.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:23:47.797+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839827:797729][7871:0x7f24333c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:23:47.797+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:23:47.808+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f24322f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F24322D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C4BC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2432FAD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2432DA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2432AAF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F243289A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F243267D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F24322D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24331B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f24322f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:23:47.808+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:24:47.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] MongoDB starting : pid=8075 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:24:47.942+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:24:47.993+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:24:48.303+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839888:303783][8075:0x7fb5479a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:24:48.303+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:24:48.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb5468d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB5468B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB54758A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB547386000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB54708C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB546E77000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB546C5A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5468B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB547793000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb5468d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:24:48.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:25:47.455+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] MongoDB starting : pid=8272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:25:47.463+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:25:47.512+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:25:47.868+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507839947:868306][8272:0x7ff0ad983c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:25:47.868+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:25:47.888+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff0ac8b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0AC892000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41DC8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF0AD56A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF0AD366000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF0AD06C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF0ACE57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF0ACC3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0AC892000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF0AD773000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff0ac8b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:25:47.888+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:26:47.456+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] MongoDB starting : pid=8545 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:26:47.464+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:26:47.514+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:26:47.887+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840007:887705][8545:0x7f90aab55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:26:47.887+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:26:47.898+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90a9a85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90A9A64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B6A7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90AA73C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90AA538000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90AA23E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90AA029000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90A9E0C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90A9A64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90AA945000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90a9a85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:26:47.898+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:27:48.031+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] MongoDB starting : pid=8763 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:27:48.039+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:27:48.090+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:27:48.467+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840068:467498][8763:0x7f6ebf0bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:27:48.467+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:27:48.487+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6ebdfea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6EBDFC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74C11000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6EBECA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6EBEA9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6EBE7A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6EBE58E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6EBE371000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6EBDFC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6EBEEAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6ebdfea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:27:48.487+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:28:47.609+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] MongoDB starting : pid=8915 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:28:47.617+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:28:47.666+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:28:47.927+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840127:927737][8915:0x7fd6904f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:28:47.927+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:28:47.938+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd68f422635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD68F401000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000002B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD6900D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD68FED5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD68FBDB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD68F9C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD68F7A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD68F401000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD6902E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd68f422635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:28:47.938+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:29:47.062+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] MongoDB starting : pid=9196 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:29:47.069+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:29:47.119+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:29:47.512+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840187:512098][9196:0x7f42950c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:29:47.512+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:29:47.531+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4293ff9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4293FD8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4294CB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4294AAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F42947B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F429459D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4294380000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4293FD8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4294EB9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4293ff9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:29:47.531+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:30:47.651+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] MongoDB starting : pid=9400 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:30:47.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:30:47.707+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:30:48.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840248:41152][9400:0x7f2c014aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:30:48.041+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:30:48.061+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c003de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C003BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE52BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C01095000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C00E91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C00B97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C00982000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C00765000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C003BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C0129E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c003de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:30:48.061+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:31:47.905+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=9649 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:31:47.913+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:31:47.964+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:31:48.354+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840308:354852][9649:0x7fcbd63a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:31:48.354+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:31:48.374+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbd52d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBD52B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBD5F90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBD5D8C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBD5A92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBD587D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBD5660000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBD52B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBD6199000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbd52d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:31:48.374+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:32:47.495+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] MongoDB starting : pid=9859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:32:47.503+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:32:47.553+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:32:47.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840367:933917][9859:0x7f90cd0cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:32:47.934+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:32:47.953+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90cbffa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90CBFD9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26A10000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90CCCB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90CCAAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90CC7B3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90CC59E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90CC381000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90CBFD9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90CCEBA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90cbffa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:32:47.953+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:33:47.079+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] MongoDB starting : pid=10002 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:33:47.087+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:33:47.137+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:33:47.457+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840427:457705][10002:0x7fe793667c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:33:47.457+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:33:47.468+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe792597635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE792576000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE79324E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE79304A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE792D50000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE792B3B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE79291E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE792576000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE793457000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe792597635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:33:47.468+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:34:47.593+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=10288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:34:47.601+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:34:47.651+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:34:47.920+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840487:920577][10288:0x7f88fa0e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:34:47.920+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:34:47.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88f9014635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88F8FF3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F88F9CCB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F88F9AC7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F88F97CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F88F95B8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F88F939B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88F8FF3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F88F9ED4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88f9014635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:34:47.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:35:47.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] MongoDB starting : pid=10491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:35:47.053+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:35:47.103+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:35:47.441+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840547:441654][10491:0x7f50e85b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:35:47.441+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:35:47.452+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f50e74e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F50E74C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF86FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F50E81A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F50E7F9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F50E7CA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F50E7A8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F50E7870000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F50E74C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F50E83A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f50e74e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:35:47.452+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:36:47.389+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] MongoDB starting : pid=10739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:36:47.397+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:36:47.449+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:36:47.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840607:805110][10739:0x7f1d5c6b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:36:47.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:36:47.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d5b5e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D5B5C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF69DBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D5C299000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D5C095000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D5BD9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D5BB86000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D5B969000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D5B5C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D5C4A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d5b5e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:36:47.816+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:37:47.946+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] MongoDB starting : pid=10951 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:37:47.953+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:37:48.005+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:37:48.383+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840668:383160][10951:0x7fc121292c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:37:48.383+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:37:48.398+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1201c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1201A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF332FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC120E79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC120C75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC12097B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC120766000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC120549000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1201A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC121082000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1201c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:37:48.398+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:38:47.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] MongoDB starting : pid=11097 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:38:47.542+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:38:47.593+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:38:48.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840728:19250][11097:0x7f56d6242c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:38:48.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:38:48.038+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56d5172635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56D5151000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "800000070000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56D5E29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56D5C25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56D592B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56D5716000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56D54F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56D5151000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56D6032000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56d5172635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:38:48.039+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:39:47.178+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:39:47.185+0000 I CONTROL [initandlisten] MongoDB starting : pid=11386 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:39:47.186+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:39:47.235+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:39:47.612+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840787:612201][11386:0x7fd607425c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:39:47.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:39:47.631+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd606355635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD606334000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE144A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD60700C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD606E08000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD606B0E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD6068F9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD6066DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD606334000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD607215000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd606355635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:39:47.631+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:40:47.760+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:40:47.767+0000 I CONTROL [initandlisten] MongoDB starting : pid=11588 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:40:47.767+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:40:47.767+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:40:47.767+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:40:47.767+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:40:47.767+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:40:47.768+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:40:47.768+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:40:47.768+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:40:47.818+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:40:48.235+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840848:235939][11588:0x7f8ef2a2fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:40:48.236+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:40:48.255+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ef195f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EF193E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDCAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EF2616000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EF2412000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EF2118000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EF1F03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EF1CE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EF193E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EF281F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ef195f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:40:48.255+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:41:47.689+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] MongoDB starting : pid=11837 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:41:47.697+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:41:47.746+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:41:48.081+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840908:81689][11837:0x7f4a7b98cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:41:48.081+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:41:48.093+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a7a8bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A7A89B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51426000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A7B573000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A7B36F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A7B075000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A7AE60000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A7AC43000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A7A89B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A7B77C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a7a8bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:41:48.093+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:42:47.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=12053 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:42:47.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:42:47.267+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:42:47.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507840967:674082][12053:0x7f1461a53c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:42:47.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:42:47.684+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1460983635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1460962000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA4A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F146163A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1461436000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F146113C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1460F27000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1460D0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1460962000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1461843000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1460983635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:42:47.684+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:43:47.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] MongoDB starting : pid=12212 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:43:47.823+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:43:47.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:43:48.254+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841028:254858][12212:0x7f1761616c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:43:48.254+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:43:48.273+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1760546635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1760525000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC5AFB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F17611FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1760FF9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1760CFF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1760AEA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17608CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1760525000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1761406000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1760546635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:43:48.274+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:44:47.395+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] MongoDB starting : pid=12494 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:44:47.403+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:44:47.454+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:44:47.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841087:696344][12494:0x7f8290570c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:44:47.696+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:44:47.706+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f828f4a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F828F47F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF878FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8290157000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F828FF53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F828FC59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F828FA44000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F828F827000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F828F47F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8290360000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f828f4a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:44:47.706+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:45:47.838+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] MongoDB starting : pid=12699 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:45:47.846+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:45:47.896+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:45:48.170+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841148:170043][12699:0x7f09312c0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:45:48.170+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:45:48.180+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09301f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09301CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E6D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0930EA7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0930CA3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09309A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0930794000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0930577000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09301CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09310B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09301f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:45:48.180+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:46:47.997+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] MongoDB starting : pid=12947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:46:48.004+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:46:48.055+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:46:48.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841208:409996][12947:0x7f2797981c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:46:48.410+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:46:48.420+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27968b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2796890000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF196E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2797568000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2797364000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F279706A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2796E55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2796C38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2796890000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2797771000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27968b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:46:48.420+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:47:47.538+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] MongoDB starting : pid=13161 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:47:47.546+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:47:47.595+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:47:47.957+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841267:957787][13161:0x7f8a7987fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:47:47.957+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:47:47.969+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8a787af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8A7878E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFB09D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8A79466000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8A79262000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8A78F68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8A78D53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8A78B36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8A7878E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8A7966F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8a787af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:47:47.969+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:48:47.092+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:48:47.100+0000 I CONTROL [initandlisten] MongoDB starting : pid=13314 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:48:47.101+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:48:47.151+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:48:47.443+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841327:443857][13314:0x7f7d1390ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:48:47.443+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:48:47.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d1283a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D12819000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF286EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D134F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D132ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D12FF3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D12DDE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D12BC1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D12819000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D136FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d1283a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:48:47.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:49:47.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] MongoDB starting : pid=13592 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:49:47.603+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:49:47.653+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:49:48.049+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841388:49376][13592:0x7fbbbb3bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:49:48.049+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:49:48.068+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbbba2ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBBBA2CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9DCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBBBAFA4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBBBADA0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBBBAAA6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBBBA891000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBBBA674000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBBBA2CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBBBB1AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbbba2ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:49:48.068+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:50:47.190+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] MongoDB starting : pid=13794 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:50:47.198+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:50:47.247+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:50:47.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841447:561582][13794:0x7fe73f748c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:50:47.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:50:47.572+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe73e678635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE73E657000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90AFC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE73F32F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE73F12B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE73EE31000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE73EC1C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE73E9FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE73E657000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE73F538000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe73e678635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:50:47.572+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:51:47.604+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] MongoDB starting : pid=14045 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:51:47.612+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:51:47.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:51:47.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841507:994219][14045:0x7f80e2c8fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:51:47.994+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:51:48.004+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80e1bbf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80E1B9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80E2876000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80E2672000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80E2378000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80E2163000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80E1F46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80E1B9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80E2A7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80e1bbf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:51:48.004+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:52:47.127+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] MongoDB starting : pid=14265 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:52:47.134+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:52:47.186+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:52:47.527+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841567:527950][14265:0x7f4d54baac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:52:47.528+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:52:47.538+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d53ada635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D53AB9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF806FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D54791000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D5458D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D54293000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D5407E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D53E61000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D53AB9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D5499A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d53ada635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:52:47.538+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:53:47.675+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] MongoDB starting : pid=14528 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:53:47.683+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:53:47.734+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:53:48.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841628:153463][14528:0x7f5ee2ad3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:53:48.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:53:48.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ee1a03635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5EE19E2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF890FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EE26BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EE24B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EE21BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5EE1FA7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5EE1D8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5EE19E2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EE28C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ee1a03635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:53:48.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:54:47.306+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] MongoDB starting : pid=15056 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:54:47.314+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:54:47.366+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:54:47.690+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841687:690747][15056:0x7f644c917c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:54:47.690+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:54:47.701+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f644b847635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F644B826000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD90FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F644C4FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F644C2FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F644C000000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F644BDEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F644BBCE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F644B826000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F644C707000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f644b847635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:54:47.701+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:55:47.820+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] MongoDB starting : pid=15257 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:55:47.828+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:55:47.877+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:55:48.163+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841748:163415][15257:0x7f4024accc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:55:48.163+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:55:48.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40239fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40239DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF690CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40246B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40244AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40241B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4023FA0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4023D83000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40239DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40248BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40239fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:55:48.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:56:47.719+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=15517 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:56:47.726+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:56:47.727+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:56:47.776+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:56:48.056+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841808:56214][15517:0x7f0034ac0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:56:48.056+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:56:48.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00339f0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00339CF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00346A7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00344A3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00341A9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0033F94000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0033D77000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00339CF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00348B0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00339f0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:56:48.066+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:57:47.214+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] MongoDB starting : pid=15734 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:57:47.222+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:57:47.273+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:57:47.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841867:556584][15734:0x7f8d6f171c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:57:47.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:57:47.567+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d6e0a1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D6E080000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D6ED58000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D6EB54000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D6E85A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D6E645000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D6E428000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D6E080000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D6EF61000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d6e0a1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:57:47.567+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:58:47.692+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] MongoDB starting : pid=15887 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:58:47.700+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:58:47.751+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:58:48.095+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841928:95776][15887:0x7f5928936c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:58:48.095+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:58:48.106+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5927866635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5927845000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF68AC5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F592851D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5928319000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F592801F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5927E0A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5927BED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5927845000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5928726000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5927866635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:58:48.106+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T20:59:47.234+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T20:59:47.241+0000 I CONTROL [initandlisten] MongoDB starting : pid=16020 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] modules: none 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] build environment: 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T20:59:47.242+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T20:59:47.292+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T20:59:47.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507841987:702581][16020:0x7f001ae77c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T20:59:47.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T20:59:47.723+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0019da7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0019D86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F770000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F001AA5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F001A85A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F001A560000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F001A34B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F001A12E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0019D86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F001AC67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0019da7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T20:59:47.723+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:00:47.858+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] MongoDB starting : pid=16276 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:00:47.868+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:00:47.917+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:00:48.324+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842048:324885][16276:0x7f2c67974c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:00:48.324+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:00:48.335+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c668a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C66883000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1ED9E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C6755B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C67357000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C6705D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C66E48000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C66C2B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C66883000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C67764000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c668a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:00:48.335+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:01:47.833+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] MongoDB starting : pid=16526 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:01:47.841+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:01:47.891+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:01:48.254+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842108:254781][16526:0x7f042651dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:01:48.254+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:01:48.275+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f042544d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F042542C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF970FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0426104000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0425F00000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0425C06000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04259F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04257D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F042542C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F042630D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f042544d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:01:48.275+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:02:47.871+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] MongoDB starting : pid=16751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:02:47.879+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:02:47.929+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:02:48.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842168:296428][16751:0x7f25d5746c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:02:48.296+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:02:48.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25d4676635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25D4655000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF730FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25D532D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F25D5129000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25D4E2F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25D4C1A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25D49FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25D4655000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25D5536000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25d4676635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:02:48.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:03:47.446+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:03:47.453+0000 I CONTROL [initandlisten] MongoDB starting : pid=16978 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:03:47.453+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:03:47.453+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:03:47.453+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:03:47.453+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:03:47.454+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:03:47.454+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:03:47.454+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:03:47.454+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:03:47.503+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:03:47.842+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842227:842951][16978:0x7f83768aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:03:47.843+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:03:47.853+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83757da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83757B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA988000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8376491000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F837628D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8375F93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8375D7E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8375B61000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83757B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F837669A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83757da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:03:47.853+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:04:47.974+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] MongoDB starting : pid=17125 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:04:47.982+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:04:48.034+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:04:48.434+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842288:434543][17125:0x7faabb3cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:04:48.434+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:04:48.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faaba2fd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAABA2DC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A01D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAABAFB4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAABADB0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAABAAB6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAABA8A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAABA684000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAABA2DC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAABB1BD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faaba2fd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:04:48.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:05:47.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=17384 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:05:47.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:05:47.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:05:47.991+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842347:991164][17384:0x7f9acc355c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:05:47.991+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:05:48.001+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9acb285635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9ACB264000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9ACBF3C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9ACBD38000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9ACBA3E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9ACB829000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9ACB60C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9ACB264000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9ACC145000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9acb285635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:05:48.001+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:06:48.019+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] MongoDB starting : pid=17629 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:06:48.027+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:06:48.079+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:06:48.431+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842408:431506][17629:0x7fc2c9072c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:06:48.431+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:06:48.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc2c7fa2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC2C7F81000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CE98000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC2C8C59000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC2C8A55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC2C875B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC2C8546000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC2C8329000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC2C7F81000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC2C8E62000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc2c7fa2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:06:48.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:07:47.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] MongoDB starting : pid=17846 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:07:47.594+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:07:47.644+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:07:47.947+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842467:947131][17846:0x7f1e0910dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:07:47.947+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:07:47.957+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e0803d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E0801C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAB8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E08CF4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E08AF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E087F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E085E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E083C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E0801C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E08EFD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e0803d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:07:47.957+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:08:47.083+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] MongoDB starting : pid=18076 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:08:47.091+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:08:47.092+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:08:47.143+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:08:47.491+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842527:491267][18076:0x7fcb4254fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:08:47.491+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:08:47.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb4147f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB4145E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB42136000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB41F32000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB41C38000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB41A23000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB41806000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB4145E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB4233F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb4147f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:08:47.502+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:09:47.640+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] MongoDB starting : pid=18221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:09:47.647+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:09:47.697+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:09:48.114+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842588:114265][18221:0x7fd86c1abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:09:48.114+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:09:48.133+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd86b0db635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD86B0BA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD86BD92000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD86BB8E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD86B894000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD86B67F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD86B462000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD86B0BA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD86BF9B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd86b0db635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:09:48.133+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:10:47.262+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] MongoDB starting : pid=18476 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:10:47.270+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:10:47.319+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:10:47.593+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842647:593150][18476:0x7ffe2b7ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:10:47.593+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:10:47.603+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffe2a71b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFE2A6FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFE2B3D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE2B1CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE2AED4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE2ACBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE2AAA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE2A6FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE2B5DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffe2a71b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:10:47.603+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:11:47.261+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] MongoDB starting : pid=18731 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:11:47.269+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:11:47.322+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:11:47.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842707:643345][18731:0x7f2206e36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:11:47.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:11:47.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2205d66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2205D45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF46AFD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2206A1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2206819000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F220651F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F220630A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22060ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2205D45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2206C26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2205d66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:11:47.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:12:47.783+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] MongoDB starting : pid=18959 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:12:47.791+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:12:47.841+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:12:48.104+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842768:104002][18959:0x7fcec3f40c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:12:48.104+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:12:48.114+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcec2e70635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCEC2E4F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36C25000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCEC3B27000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCEC3923000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCEC3629000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCEC3414000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCEC31F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCEC2E4F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCEC3D30000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcec2e70635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:12:48.114+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:13:47.243+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=19193 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:13:47.251+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:13:47.302+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:13:47.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842827:702689][19193:0x7f3b34565c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:13:47.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:13:47.724+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b33495635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B33474000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3B3414C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3B33F48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3B33C4E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3B33A39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B3381C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B33474000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3B34355000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b33495635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:13:47.724+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:14:47.851+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] MongoDB starting : pid=19336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:14:47.859+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:14:47.908+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:14:48.202+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842888:202801][19336:0x7f053fa3fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:14:48.202+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:14:48.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f053e96f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F053E94E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5837D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F053F626000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F053F422000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F053F128000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F053EF13000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F053ECF6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F053E94E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F053F82F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f053e96f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:14:48.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:15:47.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] MongoDB starting : pid=19591 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:15:47.347+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:15:47.398+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:15:47.794+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507842947:794336][19591:0x7f79f3585c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:15:47.794+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:15:47.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f79f24b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79F2494000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF880FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79F316C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79F2F68000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79F2C6E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F79F2A59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79F283C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79F2494000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79F3375000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f79f24b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:15:47.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:16:47.226+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] MongoDB starting : pid=19829 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:16:47.233+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:16:47.284+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:16:47.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843007:702090][19829:0x7f47b521fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:16:47.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:16:47.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f47b414f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47B412E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F47B4E06000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F47B4C02000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F47B4908000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F47B46F3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47B44D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47B412E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47B500F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f47b414f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:16:47.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:17:47.565+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:17:47.572+0000 I CONTROL [initandlisten] MongoDB starting : pid=20056 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:17:47.572+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:17:47.572+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:17:47.572+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:17:47.573+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:17:47.573+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:17:47.573+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:17:47.573+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:17:47.573+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:17:47.627+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:17:47.947+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843067:947080][20056:0x7f6960475c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:17:47.947+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:17:47.958+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f695f3a5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F695F384000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF686FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F696005C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F695FE58000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F695FB5E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F695F949000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F695F72C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F695F384000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6960265000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f695f3a5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:17:47.958+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:18:47.091+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] MongoDB starting : pid=20297 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:18:47.099+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:18:47.149+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:18:47.433+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843127:433894][20297:0x7fe5424a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:18:47.433+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:18:47.445+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe5413d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5413B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF732FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE54208C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE541E88000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE541B8E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE541979000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE54175C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5413B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE542295000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe5413d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:18:47.445+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:19:47.585+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:19:47.592+0000 I CONTROL [initandlisten] MongoDB starting : pid=20429 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:19:47.592+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:19:47.592+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:19:47.592+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:19:47.593+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:19:47.593+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:19:47.593+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:19:47.593+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:19:47.593+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:19:47.635+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:19:47.988+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843187:988308][20429:0x7f50f4711c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:19:47.988+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:19:47.999+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f50f3641635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F50F3620000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF170FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F50F42F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F50F40F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F50F3DFA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F50F3BE5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F50F39C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F50F3620000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F50F4501000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f50f3641635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:19:47.999+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:20:47.135+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] MongoDB starting : pid=20698 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:20:47.143+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:20:47.192+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:20:47.467+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843247:467457][20698:0x7ffcc7c24c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:20:47.467+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:20:47.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffcc6b54635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFCC6B33000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFCC780B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFCC7607000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFCC730D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFCC70F8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFCC6EDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFCC6B33000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFCC7A14000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffcc6b54635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:20:47.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:21:47.874+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] MongoDB starting : pid=20958 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:21:47.881+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:21:47.930+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:21:48.205+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843308:205809][20958:0x7f62c7abac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:21:48.205+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:21:48.216+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62c69ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62C69C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEF6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62C76A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62C749D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62C71A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62C6F8E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62C6D71000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62C69C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62C78AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62c69ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:21:48.216+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:22:47.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] MongoDB starting : pid=21179 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:22:47.662+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:22:47.713+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:22:47.999+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843367:999652][21179:0x7f94ba3b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:22:47.999+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:22:48.010+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94b92e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F94B92C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFECEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F94B9F9B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F94B9D97000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F94B9A9D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F94B9888000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F94B966B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F94B92C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94BA1A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94b92e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:22:48.010+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:23:47.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] MongoDB starting : pid=21413 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:23:47.149+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:23:47.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:23:47.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:23:47.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:23:47.620+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843427:620209][21413:0x7fe06cb5ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:23:47.620+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:23:47.639+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe06ba8a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE06BA69000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF984FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE06C741000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE06C53D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE06C243000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE06C02E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE06BE11000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE06BA69000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE06C94A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe06ba8a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:23:47.639+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:24:47.768+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] MongoDB starting : pid=21541 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:24:47.776+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:24:47.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:24:48.319+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843488:319495][21541:0x7f96618c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:24:48.319+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:24:48.342+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96607f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96607D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF02076000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96614AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96612A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9660FAC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9660D97000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9660B7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96607D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96616B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96607f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:24:48.342+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:25:47.469+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=21819 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:25:47.477+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:25:47.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:25:47.887+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843547:887398][21819:0x7f80c3a3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:25:47.887+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:25:47.898+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80c296c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80C294B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80C3623000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80C341F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80C3125000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80C2F10000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80C2CF3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80C294B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80C382C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80c296c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:25:47.898+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:26:47.366+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=22054 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:26:47.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:26:47.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:26:47.832+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843607:832731][22054:0x7f5e2e4c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:26:47.832+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:26:47.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e2d3f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E2D3D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E2E0AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E2DEA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E2DBAF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E2D99A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E2D77D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E2D3D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E2E2B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e2d3f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:26:47.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:27:47.327+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] MongoDB starting : pid=22270 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:27:47.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:27:47.386+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:27:47.785+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843667:785174][22270:0x7f7155010c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:27:47.785+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:27:47.805+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7153f40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7153F1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF506FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7154BF7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71549F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71546F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71544E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71542C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7153F1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7154E00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7153f40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:27:47.805+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:28:47.936+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] MongoDB starting : pid=22524 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:28:47.944+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:28:47.997+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:28:48.271+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843728:271785][22524:0x7fd5993cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:28:48.271+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:28:48.282+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5982fd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5982DC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD598FB4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD598DB0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD598AB6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5988A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD598684000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5982DC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5991BD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5982fd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:28:48.282+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:29:47.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] MongoDB starting : pid=22638 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:29:47.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:29:47.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:29:47.898+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843787:898423][22638:0x7fb8a001dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:29:47.898+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:29:47.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb89ef4d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB89EF2C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB89FC04000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB89FA00000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB89F706000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB89F4F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB89F2D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB89EF2C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB89FE0D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb89ef4d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:29:47.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:30:48.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:30:48.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=22928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:30:48.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:30:48.055+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:30:48.105+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:30:48.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843848:459515][22928:0x7fa7e9cf4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:30:48.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:30:48.478+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7e8c24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7E8C03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38EDA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7E98DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7E96D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7E93DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7E91C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7E8FAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7E8C03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7E9AE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7e8c24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:30:48.478+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:31:47.968+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] MongoDB starting : pid=23156 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:31:47.976+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:31:48.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:31:48.373+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843908:373076][23156:0x7f05899cbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:31:48.373+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:31:48.384+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f05888fb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F05888DA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F05895B2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F05893AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F05890B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0588E9F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0588C82000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F05888DA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F05897BB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f05888fb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:31:48.384+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:32:47.831+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:32:47.838+0000 I CONTROL [initandlisten] MongoDB starting : pid=23377 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:32:47.839+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:32:47.889+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:32:48.246+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507843968:246499][23377:0x7f47f7756c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:32:48.246+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:32:48.265+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f47f6686635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47F6665000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF608FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F47F733D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F47F7139000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F47F6E3F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F47F6C2A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47F6A0D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47F6665000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47F7546000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f47f6686635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:32:48.265+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:33:47.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] MongoDB starting : pid=23558 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:33:47.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:33:47.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:33:47.869+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844027:869362][23558:0x7f6a18d74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:33:47.869+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:33:47.888+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6a17ca4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6A17C83000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF312C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6A1895B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6A18757000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6A1845D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6A18248000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6A1802B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6A17C83000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6A18B64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6a17ca4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:33:47.888+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:34:48.009+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] MongoDB starting : pid=23728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:34:48.016+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:34:48.069+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:34:48.419+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844088:419361][23728:0x7f2cb518ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:34:48.419+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:34:48.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2cb40ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CB4099000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C6FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CB4D71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CB4B6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CB4873000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CB465E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CB4441000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CB4099000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CB4F7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2cb40ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:34:48.439+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:35:47.563+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] MongoDB starting : pid=23871 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:35:47.571+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:35:47.626+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:35:47.942+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844147:942778][23871:0x7fe33ef21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:35:47.942+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:35:47.955+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe33de51635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE33DE30000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEE478000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE33EB08000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE33E904000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE33E60A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE33E3F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE33E1D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE33DE30000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE33ED11000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe33de51635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:35:47.955+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:36:47.402+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] MongoDB starting : pid=24154 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:36:47.410+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:36:47.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:36:47.829+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844207:829021][24154:0x7f3e28402c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:36:47.829+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:36:47.848+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e27332635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E27311000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF412FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E27FE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E27DE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E27AEB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E278D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E276B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E27311000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E281F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e27332635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:36:47.848+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:37:47.298+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] MongoDB starting : pid=24378 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:37:47.305+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:37:47.355+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:37:47.734+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844267:734164][24378:0x7f9c79998c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:37:47.734+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:37:47.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c788c8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C788A7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEBCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C7957F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C7937B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C79081000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C78E6C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C78C4F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C788A7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C79788000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c788c8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:37:47.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:38:47.885+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] MongoDB starting : pid=24618 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:38:47.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:38:47.896+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:38:47.955+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:38:48.364+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844328:364279][24618:0x7fa4b1858c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:38:48.364+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:38:48.383+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa4b0788635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA4B0767000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA4B143F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA4B123B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA4B0F41000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA4B0D2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA4B0B0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA4B0767000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA4B1648000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa4b0788635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:38:48.383+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:39:47.518+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=24817 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:39:47.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:39:47.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:39:47.993+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844387:993562][24817:0x7f5dd8285c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:39:47.993+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:39:48.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5dd71b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5DD7194000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6382D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5DD7E6C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5DD7C68000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5DD796E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5DD7759000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5DD753C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5DD7194000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5DD8075000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5dd71b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:39:48.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:40:47.134+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] MongoDB starting : pid=24970 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:40:47.142+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:40:47.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:40:47.632+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844447:632193][24970:0x7f1cba2a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:40:47.632+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:40:47.652+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1cb91d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CB91B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60469000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CB9E8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CB9C88000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CB998E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CB9779000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CB955C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CB91B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CBA095000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1cb91d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:40:47.652+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:41:48.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] MongoDB starting : pid=25257 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:41:48.063+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:41:48.114+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:41:48.518+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844508:518340][25257:0x7ff61a90bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:41:48.518+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:41:48.540+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff61983b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF61981A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF590FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF61A4F2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF61A2EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF619FF4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF619DDF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF619BC2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF61981A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF61A6FB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff61983b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:41:48.540+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:42:47.467+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] MongoDB starting : pid=25491 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:42:47.475+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:42:47.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:42:47.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844567:784852][25491:0x7fdbb0e64c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:42:47.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:42:47.795+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdbafd94635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDBAFD73000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDBB0A4B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDBB0847000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDBB054D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDBB0338000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDBB011B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDBAFD73000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDBB0C54000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdbafd94635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:42:47.795+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:43:47.922+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] MongoDB starting : pid=25752 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:43:47.929+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:43:47.979+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:43:48.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844628:276281][25752:0x7ffd882ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:43:48.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:43:48.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd8722f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD8720E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD87EE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD87CE2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD879E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD877D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD875B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD8720E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD880EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd8722f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:43:48.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:44:47.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] MongoDB starting : pid=25950 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:44:47.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:44:47.471+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:44:47.754+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844687:754977][25950:0x7f7814512c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:44:47.755+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:44:47.765+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7813442635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7813421000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF576FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78140F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7813EF5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7813BFB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78139E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78137C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7813421000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7814302000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7813442635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:44:47.765+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:45:47.899+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=26096 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:45:47.907+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:45:47.957+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:45:48.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844748:240541][26096:0x7fec2de92c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:45:48.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:45:48.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec2cdc2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC2CDA1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF812FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC2DA79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC2D875000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC2D57B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC2D366000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC2D149000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC2CDA1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC2DC82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec2cdc2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:45:48.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:46:47.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] MongoDB starting : pid=26368 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:46:47.663+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:46:47.713+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:46:48.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844808:3167][26368:0x7f7da41bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:46:48.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:46:48.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7da30ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DA30C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF3E94000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DA3DA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DA3B9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DA38A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DA368E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DA3471000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DA30C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DA3FAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7da30ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:46:48.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:47:47.835+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] MongoDB starting : pid=26593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:47:47.843+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:47:47.844+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:47:47.894+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:47:48.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844868:209853][26593:0x7f7eca55cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:47:48.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:47:48.221+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ec948c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EC946B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7ECA143000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EC9F3F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EC9C45000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EC9A30000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EC9813000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EC946B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7ECA34C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ec948c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:47:48.221+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:48:47.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] MongoDB starting : pid=26834 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:48:47.347+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:48:47.399+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:48:47.775+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844927:775864][26834:0x7f76331ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:48:47.775+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:48:47.795+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f76320fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F76320DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF802FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7632DB3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7632BAF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F76328B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F76326A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7632483000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F76320DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7632FBC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f76320fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:48:47.795+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:49:47.926+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] MongoDB starting : pid=27033 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:49:47.934+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:49:47.985+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:49:48.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507844988:315517][27033:0x7f406546ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:49:48.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:49:48.326+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f406439a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4064379000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1EFB8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4065051000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4064E4D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4064B53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F406493E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4064721000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4064379000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F406525A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f406439a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:49:48.326+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:50:47.453+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=27180 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:50:47.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:50:47.511+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:50:47.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845047:782872][27180:0x7f8ea2578c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:50:47.782+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:50:47.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ea14a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EA1487000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB04FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EA215F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EA1F5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EA1C61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EA1A4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EA182F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EA1487000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EA2368000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ea14a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:50:47.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:51:47.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] MongoDB starting : pid=27449 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:51:47.177+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:51:47.228+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:51:47.487+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845107:487672][27449:0x7f2475402c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:51:47.487+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:51:47.498+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2474332635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2474311000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF46AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2474FE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2474DE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2474AEB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F24748D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F24746B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2474311000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F24751F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2474332635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:51:47.498+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:52:47.086+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=27684 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:52:47.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:52:47.145+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:52:47.478+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845167:478169][27684:0x7f7bbf839c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:52:47.478+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:52:47.491+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7bbe769635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7BBE748000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF73418000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7BBF420000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7BBF21C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7BBEF22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7BBED0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7BBEAF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7BBE748000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7BBF629000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7bbe769635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:52:47.491+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:53:47.624+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] MongoDB starting : pid=27917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:53:47.632+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:53:47.681+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:53:47.990+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845227:990029][27917:0x7fedc7d8fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:53:47.990+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:53:48.010+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fedc6cbf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEDC6C9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF81EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEDC7976000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEDC7772000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEDC7478000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEDC7263000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEDC7046000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEDC6C9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEDC7B7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fedc6cbf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:53:48.010+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:54:47.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=28126 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:54:47.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:54:47.202+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:54:47.500+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845287:500402][28126:0x7f928357bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:54:47.500+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:54:47.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f92824ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F928248A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7FB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9283162000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9282F5E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9282C64000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9282A4F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9282832000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F928248A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F928336B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f92824ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:54:47.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:55:47.642+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] MongoDB starting : pid=28272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:55:47.650+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:55:47.700+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:55:48.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845348:50849][28272:0x7f73a2a9dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:55:48.050+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:55:48.061+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f73a19cd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F73A19AC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF486000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F73A2684000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F73A2480000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F73A2186000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73A1F71000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73A1D54000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F73A19AC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F73A288D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f73a19cd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:55:48.061+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:56:47.531+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] MongoDB starting : pid=28547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:56:47.540+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:56:47.590+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:56:47.935+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845407:935032][28547:0x7f2b17182c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:56:47.935+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:56:47.946+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b160b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B16091000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF07C5E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B16D69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B16B65000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B1686B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B16656000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B16439000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B16091000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B16F72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b160b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:56:47.946+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:57:47.572+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] MongoDB starting : pid=28785 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:57:47.580+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:57:47.630+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:57:47.881+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845467:881220][28785:0x7f036c368c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:57:47.881+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:57:47.891+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f036b298635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F036B277000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F036BF4F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F036BD4B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F036BA51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F036B83C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F036B61F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F036B277000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F036C158000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f036b298635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:57:47.891+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:58:48.013+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] MongoDB starting : pid=29023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:58:48.020+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:58:48.070+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:58:48.338+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845528:338224][29023:0x7fae01f21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:58:48.338+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:58:48.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fae00e51635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAE00E30000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8616000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAE01B08000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAE01904000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAE0160A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAE013F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAE011D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAE00E30000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAE01D11000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fae00e51635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:58:48.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T21:59:47.482+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T21:59:47.489+0000 I CONTROL [initandlisten] MongoDB starting : pid=29239 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T21:59:47.489+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] modules: none 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] build environment: 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T21:59:47.490+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T21:59:47.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T21:59:47.865+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845587:865257][29239:0x7f2dfb0eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T21:59:47.865+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T21:59:47.877+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2dfa01e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2DF9FFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89A8F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2DFACD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2DFAAD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2DFA7D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2DFA5C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2DFA3A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2DF9FFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2DFAEDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2dfa01e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T21:59:47.877+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:00:48.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=29387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:00:48.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:00:48.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:00:48.425+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845648:425677][29387:0x7f0af5bb1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:00:48.425+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:00:48.445+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0af4ae1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0AF4AC0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0AF5798000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0AF5594000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0AF529A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0AF5085000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0AF4E68000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0AF4AC0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0AF59A1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0af4ae1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:00:48.445+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:01:47.827+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] MongoDB starting : pid=29661 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:01:47.836+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:01:47.887+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:01:48.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845708:274918][29661:0x7f61b0c63c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:01:48.275+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:01:48.294+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61afb93635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61AFB72000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C054000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61B084A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61B0646000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61B034C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61B0137000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61AFF1A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61AFB72000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61B0A53000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61afb93635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:01:48.294+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:02:47.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] MongoDB starting : pid=29903 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:02:47.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:02:47.785+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:02:48.143+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845768:143030][29903:0x7f7ebb8f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:02:48.143+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:02:48.153+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7eba826635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EBA805000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF68CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EBB4DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EBB2D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EBAFDF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EBADCA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EBABAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EBA805000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EBB6E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7eba826635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:02:48.153+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:03:47.279+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] MongoDB starting : pid=30119 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:03:47.287+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:03:47.337+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:03:47.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845827:696152][30119:0x7f35b526dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:03:47.696+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:03:47.706+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f35b419d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F35B417C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5439000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F35B4E54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F35B4C50000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35B4956000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F35B4741000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F35B4524000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F35B417C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F35B505D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f35b419d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:03:47.706+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:04:47.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:04:47.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=30340 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:04:47.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:04:47.900+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:04:48.271+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845888:271471][30340:0x7f703df9ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:04:48.271+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:04:48.290+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f703cece635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F703CEAD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF280FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F703DB85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F703D981000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F703D687000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F703D472000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F703D255000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F703CEAD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F703DD8E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f703cece635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:04:48.290+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:05:47.416+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] MongoDB starting : pid=30485 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:05:47.424+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:05:47.425+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:05:47.475+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:05:47.810+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507845947:810738][30485:0x7f5c5ef49c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:05:47.810+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:05:47.821+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c5de79635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C5DE58000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF974FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C5EB30000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C5E92C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C5E632000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C5E41D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C5E200000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C5DE58000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C5ED39000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c5de79635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:05:47.821+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:06:47.198+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=30750 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:06:47.206+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:06:47.257+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:06:47.595+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846007:595348][30750:0x7f96ef232c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:06:47.595+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:06:47.606+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96ee162635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96EE141000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96EEE19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96EEC15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96EE91B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96EE706000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96EE4E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96EE141000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96EF022000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96ee162635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:06:47.606+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:07:47.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=30985 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:07:47.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:07:48.045+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:07:48.308+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846068:308788][30985:0x7fac7364ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:07:48.308+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:07:48.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac7257a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC72559000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF442FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC73231000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC7302D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC72D33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC72B1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC72901000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC72559000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC7343A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac7257a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:07:48.319+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:08:47.444+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] MongoDB starting : pid=31158 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:08:47.452+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:08:47.502+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:08:47.831+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846127:831186][31158:0x7fd7eb28bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:08:47.831+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:08:47.841+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7ea1bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7EA19A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF367F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7EAE72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7EAC6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7EA974000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7EA75F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7EA542000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7EA19A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7EB07B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7ea1bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:08:47.842+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:09:47.962+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=31340 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:09:47.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:09:48.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:09:48.411+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846188:411516][31340:0x7f227f68ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:09:48.411+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:09:48.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f227e5ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F227E599000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC8C81000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F227F271000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F227F06D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F227ED73000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F227EB5E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F227E941000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F227E599000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F227F47A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f227e5ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:09:48.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:10:47.567+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] MongoDB starting : pid=31569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:10:47.575+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:10:47.626+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:10:47.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846247:911236][31569:0x7f377ae24c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:10:47.911+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:10:47.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3779d54635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3779D33000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF718FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F377AA0B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F377A807000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F377A50D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F377A2F8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F377A0DB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3779D33000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F377AC14000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3779d54635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:10:47.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:11:47.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] MongoDB starting : pid=31708 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:11:47.383+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:11:47.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:11:47.703+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846307:703466][31708:0x7fad4830ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:11:47.703+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:11:47.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fad4723e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAD4721D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAD47EF5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAD47CF1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAD479F7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAD477E2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAD475C5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAD4721D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAD480FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fad4723e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:11:47.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:12:47.227+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] MongoDB starting : pid=32066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:12:47.235+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:12:47.286+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:12:47.700+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846367:700081][32066:0x7f68ad394c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:12:47.700+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:12:47.719+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68ac2c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68AC2A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF79ED2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68ACF7B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68ACD77000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68ACA7D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68AC868000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68AC64B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68AC2A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68AD184000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68ac2c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:12:47.719+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:13:47.846+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] MongoDB starting : pid=32307 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:13:47.854+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:13:47.905+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:13:48.237+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846428:237204][32307:0x7f3b0ba19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:13:48.237+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:13:48.248+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b0a949635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B0A928000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC48FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3B0B600000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3B0B3FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3B0B102000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3B0AEED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B0ACD0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B0A928000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3B0B809000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b0a949635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:13:48.248+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:14:47.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] MongoDB starting : pid=32527 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:14:47.383+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:14:47.434+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:14:47.811+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846487:811960][32527:0x7f8002b83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:14:47.812+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:14:47.831+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8001ab3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8001A92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F800276A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8002566000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F800226C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8002057000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8001E3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8001A92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8002973000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8001ab3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:14:47.831+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:15:47.968+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] MongoDB starting : pid=32755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:15:47.975+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:15:48.025+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:15:48.390+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846548:390684][32755:0x7f7b9e74bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:15:48.390+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:15:48.406+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7b9d67b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7B9D65A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0805B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7B9E332000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7B9E12E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7B9DE34000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7B9DC1F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7B9DA02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7B9D65A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7B9E53B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7b9d67b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:15:48.406+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:16:47.842+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=418 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:16:47.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:16:47.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:16:48.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846608:274802][418:0x7ff69979fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:16:48.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:16:48.295+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff6986cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF6986AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF699386000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF699182000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF698E88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF698C73000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF698A56000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF6986AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF69958F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff6986cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:16:48.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:17:47.604+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] MongoDB starting : pid=755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:17:47.612+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:17:47.663+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:17:48.004+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846668:4093][755:0x7fc26fb76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:17:48.004+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:17:48.017+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc26eaa6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC26EA85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE83E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC26F75D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC26F559000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC26F25F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC26F04A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC26EE2D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC26EA85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC26F966000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc26eaa6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:17:48.017+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:18:47.148+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] MongoDB starting : pid=971 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:18:47.155+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:18:47.156+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:18:47.156+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:18:47.205+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:18:47.532+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846727:532628][971:0x7f693e83fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:18:47.532+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:18:47.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f693d76f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F693D74E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F693E426000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F693E222000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F693DF28000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F693DD13000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F693DAF6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F693D74E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F693E62F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f693d76f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:18:47.543+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:19:47.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] MongoDB starting : pid=1193 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:19:47.675+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:19:47.725+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:19:48.061+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846788:61348][1193:0x7f19a1762c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:19:48.061+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:19:48.071+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19a0692635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19A0671000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19A1349000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19A1145000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19A0E4B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19A0C36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19A0A19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19A0671000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19A1552000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19a0692635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:19:48.071+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:20:47.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] MongoDB starting : pid=1420 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:20:47.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:20:47.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:20:47.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846847:608282][1420:0x7f7c8459bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:20:47.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:20:47.618+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7c834cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7C834AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06FBB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7C84182000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7C83F7E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7C83C84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7C83A6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7C83852000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7C834AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7C8438B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7c834cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:20:47.618+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:21:48.040+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] MongoDB starting : pid=1551 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:21:48.049+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:21:48.099+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:21:48.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846908:408756][1551:0x7f79279d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:21:48.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:21:48.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7926908635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79268E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB66D3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79275BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79273BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79270C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7926EAC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7926C8F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79268E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79277C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7926908635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:21:48.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:22:48.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=1851 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:22:48.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:22:48.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:22:48.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507846968:409730][1851:0x7f0ddc987c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:22:48.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:22:48.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ddb8b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0DDB896000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF722C9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0DDC56E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0DDC36A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0DDC070000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0DDBE5B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0DDBC3E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0DDB896000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0DDC777000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ddb8b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:22:48.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:23:47.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] MongoDB starting : pid=2072 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:23:47.558+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:23:47.608+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:23:47.947+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847027:947473][2072:0x7fbcdb7e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:23:47.947+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:23:47.966+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbcda716635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBCDA6F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12E83000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBCDB3CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBCDB1C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBCDAECF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBCDACBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBCDAA9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBCDA6F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBCDB5D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbcda716635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:23:47.967+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:24:47.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] MongoDB starting : pid=2294 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:24:47.106+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:24:47.155+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:24:47.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847087:511288][2294:0x7f3221d4ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:24:47.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:24:47.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3220c7a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3220C59000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3221931000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F322172D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3221433000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F322121E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3221001000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3220C59000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3221B3A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3220c7a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:24:47.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:25:47.649+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] MongoDB starting : pid=2526 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:25:47.657+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:25:47.708+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:25:48.056+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847148:56703][2526:0x7f9007f9cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:25:48.056+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:25:48.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9006ecc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9006EAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9C60000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9007B83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F900797F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9007685000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9007470000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9007253000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9006EAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9007D8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9006ecc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:25:48.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:26:47.523+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] MongoDB starting : pid=2652 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:26:47.531+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:26:47.581+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:26:47.836+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847207:836649][2652:0x7f6580d13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:26:47.836+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:26:47.847+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f657fc43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F657FC22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF884FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65808FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65806F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65803FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65801E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F657FFCA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F657FC22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6580B03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f657fc43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:26:47.847+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:27:47.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:27:47.641+0000 I CONTROL [initandlisten] MongoDB starting : pid=2953 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:27:47.641+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:27:47.641+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:27:47.642+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:27:47.642+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:27:47.642+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:27:47.642+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:27:47.642+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:27:47.642+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:27:47.693+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:27:47.973+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847267:973104][2953:0x7fd090ee9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:27:47.973+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:27:47.983+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd08fe19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD08FDF8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD090AD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0908CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0905D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0903BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0901A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD08FDF8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD090CD9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd08fe19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:27:47.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:28:47.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=3186 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:28:47.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:28:47.175+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:28:47.498+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847327:498879][3186:0x7f7764278c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:28:47.498+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:28:47.509+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f77631a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7763187000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43466000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7763E5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7763C5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7763961000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F776374C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F776352F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7763187000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7764068000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f77631a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:28:47.509+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:29:47.632+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] MongoDB starting : pid=3410 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:29:47.640+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:29:47.692+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:29:48.058+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847388:58676][3410:0x7fe2a4e97c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:29:48.058+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:29:48.078+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2a3dc7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2A3DA6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF89EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2A4A7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2A487A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2A4580000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2A436B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2A414E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2A3DA6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2A4C87000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2a3dc7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:29:48.078+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:30:47.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] MongoDB starting : pid=3649 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:30:47.211+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:30:47.262+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:30:47.653+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847447:653543][3649:0x7f30703e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:30:47.653+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:30:47.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f306f311635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F306F2F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58F90000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F306FFC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F306FDC4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F306FACA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F306F8B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F306F698000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F306F2F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F30701D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f306f311635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:30:47.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:31:47.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=3769 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:31:47.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:31:47.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:31:47.524+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847507:524208][3769:0x7f5ab986ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:31:47.524+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:31:47.536+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ab879a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AB8779000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CBA8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AB9451000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AB924D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AB8F53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AB8D3E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AB8B21000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AB8779000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AB965A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ab879a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:31:47.536+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:32:47.847+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] MongoDB starting : pid=4067 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:32:47.854+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:32:47.904+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:32:48.257+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847568:257531][4067:0x7f309dfefc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:32:48.257+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:32:48.277+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f309cf1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F309CEFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF904FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F309DBD6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F309D9D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F309D6D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F309D4C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F309D2A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F309CEFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F309DDDF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f309cf1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:32:48.277+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:33:47.402+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] MongoDB starting : pid=4284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:33:47.410+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:33:47.460+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:33:47.756+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847627:756235][4284:0x7fef9924ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:33:47.756+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:33:47.767+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef9817e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF9815D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3E30000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF98E35000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF98C31000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF98937000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF98722000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF98505000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF9815D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF9903E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef9817e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:33:47.767+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:34:47.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] MongoDB starting : pid=4512 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:34:47.897+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:34:47.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:34:48.257+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847688:257307][4512:0x7fa00ce75c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:34:48.257+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:34:48.281+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa00bda5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA00BD84000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40491000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA00CA5C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA00C858000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA00C55E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA00C349000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA00C12C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA00BD84000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA00CC65000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa00bda5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:34:48.281+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:35:47.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] MongoDB starting : pid=4752 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:35:47.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:35:47.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:35:47.797+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847747:797601][4752:0x7fbde4538c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:35:47.797+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:35:47.809+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbde3468635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBDE3447000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBDE411F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBDE3F1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBDE3C21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBDE3A0C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBDE37EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBDE3447000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBDE4328000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbde3468635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:35:47.809+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:36:47.209+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=4887 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:36:47.217+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:36:47.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:36:47.671+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847807:671089][4887:0x7f5c0650fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:36:47.671+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:36:47.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c0543f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C0541E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4AE9B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C060F6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C05EF2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C05BF8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C059E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C057C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C0541E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C062FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c0543f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:36:47.693+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:37:47.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] MongoDB starting : pid=5406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:37:47.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:37:47.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:37:47.557+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847867:557963][5406:0x7f5635d7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:37:47.558+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:37:47.568+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5634cad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5634C8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF266FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5635964000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5635760000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5635466000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5635251000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5635034000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5634C8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5635B6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5634cad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:37:47.568+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:38:47.698+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] MongoDB starting : pid=5745 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:38:47.705+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:38:47.755+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:38:48.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847928:173114][5745:0x7fadfcca5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:38:48.173+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:38:48.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fadfbbd5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FADFBBB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FADFC88C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FADFC688000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FADFC38E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FADFC179000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FADFBF5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FADFBBB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FADFCA95000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fadfbbd5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:38:48.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:39:47.321+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] MongoDB starting : pid=6130 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:39:47.329+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:39:47.381+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:39:47.706+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507847987:706817][6130:0x7f0a787b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:39:47.706+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:39:47.717+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a776e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A776C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF296FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A7839D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A78199000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A77E9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A77C8A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A77A6D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A776C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A785A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a776e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:39:47.717+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:40:47.856+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] MongoDB starting : pid=6501 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:40:47.864+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:40:47.915+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:40:48.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848048:291899][6501:0x7f1453ebec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:40:48.292+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:40:48.311+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1452dee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1452DCD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E426000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1453AA5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F14538A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F14535A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1453392000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1453175000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1452DCD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1453CAE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1452dee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:40:48.311+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:41:47.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:41:47.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=6628 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:41:47.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:41:47.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:41:47.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:41:47.809+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:41:47.809+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:41:47.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:41:47.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:41:47.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:41:47.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:41:48.196+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848108:196634][6628:0x7f9619664c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:41:48.196+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:41:48.210+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9618594635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9618573000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC28FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F961924B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9619047000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9618D4D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9618B38000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F961891B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9618573000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9619454000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9618594635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:41:48.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:42:47.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] MongoDB starting : pid=6956 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:42:47.418+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:42:47.469+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:42:47.856+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848167:856616][6956:0x7fa89360ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:42:47.856+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:42:47.867+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa89253a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA892519000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF647C6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8931F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA892FED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA892CF3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA892ADE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8928C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA892519000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8933FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa89253a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:42:47.867+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:43:47.996+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] MongoDB starting : pid=7185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:43:48.004+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:43:48.055+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:43:48.356+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848228:356592][7185:0x7f8bae98bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:43:48.356+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:43:48.367+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8bad8bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BAD89A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1E77000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BAE572000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BAE36E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BAE074000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BADE5F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BADC42000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BAD89A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BAE77B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8bad8bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:43:48.367+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:44:47.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] MongoDB starting : pid=7313 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:44:47.497+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:44:47.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:44:47.547+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:44:47.921+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848287:921110][7313:0x7fe0c29b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:44:47.921+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:44:47.934+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0c18e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0C18C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC2FB1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0C259A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0C2396000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE0C209C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE0C1E87000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE0C1C6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0C18C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0C27A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0c18e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:44:47.934+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:45:47.063+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] MongoDB starting : pid=7541 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:45:47.070+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:45:47.119+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:45:47.446+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848347:446685][7541:0x7f42f91e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:45:47.446+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:45:47.458+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f42f8114635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F42F80F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72C61000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F42F8DCB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F42F8BC7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F42F88CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F42F86B8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F42F849B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F42F80F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F42F8FD4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f42f8114635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:45:47.458+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:46:47.847+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] MongoDB starting : pid=7745 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:46:47.855+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:46:47.904+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:46:48.285+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848408:285159][7745:0x7f62b20eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:46:48.285+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:46:48.304+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62b101e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62B0FFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B1A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62B1CD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62B1AD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62B17D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62B15C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62B13A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62B0FFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62B1EDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62b101e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:46:48.304+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:47:47.441+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] MongoDB starting : pid=7902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:47:47.450+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:47:47.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:47:47.788+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848467:788411][7902:0x7fde0862ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:47:47.788+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:47:47.800+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde0755e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE0753D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF267E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE08215000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE08011000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE07D17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE07B02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE078E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE0753D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE0841E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde0755e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:47:47.800+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:48:47.755+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:48:47.762+0000 I CONTROL [initandlisten] MongoDB starting : pid=8172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:48:47.763+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:48:47.812+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:48:48.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848528:218262][8172:0x7f0d3180dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:48:48.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:48:48.238+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d3073d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D3071C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF012E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D313F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D311F0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D30EF6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D30CE1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D30AC4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D3071C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D315FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d3073d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:48:48.238+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:49:47.374+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] MongoDB starting : pid=8399 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:49:47.382+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:49:47.432+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:49:47.839+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848587:839702][8399:0x7f46a9997c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:49:47.839+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:49:47.858+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f46a88c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F46A88A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C80C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F46A957E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F46A937A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F46A9080000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F46A8E6B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F46A8C4E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F46A88A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F46A9787000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f46a88c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:49:47.858+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:50:47.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=8645 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:50:47.998+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:50:48.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:50:48.406+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848648:406836][8645:0x7ffd096ccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:50:48.406+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:50:48.426+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd085fc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD085DB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAAAB6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD092B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD090AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD08DB5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD08BA0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD08983000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD085DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD094BC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd085fc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:50:48.426+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:51:47.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] MongoDB starting : pid=8851 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:51:47.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:51:47.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:51:48.332+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848708:332084][8851:0x7f1f70ef5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:51:48.332+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:51:48.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f6fe25635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F6FE04000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F70ADC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F708D8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F705DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F703C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F701AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F6FE04000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F70CE5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f6fe25635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:51:48.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:52:47.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=9012 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:52:47.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:52:47.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:52:47.927+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848767:927538][9012:0x7fb4d772dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:52:47.927+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:52:47.947+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb4d665d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB4D663C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF23EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB4D7314000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB4D7110000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB4D6E16000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB4D6C01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB4D69E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB4D663C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB4D751D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb4d665d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:52:47.947+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:53:47.255+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] MongoDB starting : pid=9271 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:53:47.263+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:53:47.313+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:53:47.653+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848827:653114][9271:0x7f0b4fdddc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:53:47.653+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:53:47.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0b4ed0d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0B4ECEC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8698E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0B4F9C4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0B4F7C0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0B4F4C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0B4F2B1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0B4F094000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0B4ECEC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0B4FBCD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0b4ed0d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:53:47.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:54:47.804+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] MongoDB starting : pid=9505 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:54:47.812+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:54:47.813+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:54:47.813+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:54:47.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:54:48.217+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848888:217869][9505:0x7f9669886c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:54:48.217+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:54:48.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96687b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9668795000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14ABC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F966946D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9669269000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9668F6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9668D5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9668B3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9668795000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9669676000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96687b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:54:48.230+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:55:47.346+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] MongoDB starting : pid=9732 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:55:47.354+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:55:47.403+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:55:47.735+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507848947:735243][9732:0x7f1603fb2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:55:47.735+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:55:47.745+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1602ee2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1602EC1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEFFF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1603B99000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1603995000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F160369B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1603486000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1603269000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1602EC1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1603DA2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1602ee2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:55:47.745+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:56:47.185+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] MongoDB starting : pid=9937 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:56:47.193+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:56:47.244+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:56:47.595+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849007:595470][9937:0x7f93b474cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:56:47.595+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:56:47.607+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93b367c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93B365B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93B4333000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93B412F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93B3E35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93B3C20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93B3A03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93B365B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93B453C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93b367c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:56:47.607+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:57:47.727+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] MongoDB starting : pid=10102 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:57:47.735+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:57:47.784+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:57:48.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849068:129424][10102:0x7f6187d80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:57:48.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:57:48.149+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6186cb0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6186C8F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C2D8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6187967000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6187763000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6187469000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6187254000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6187037000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6186C8F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6187B70000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6186cb0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:57:48.149+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:58:47.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=10375 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:58:47.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:58:47.541+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:58:47.924+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849127:924306][10375:0x7fa79a3c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:58:47.924+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:58:47.934+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7992f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7992D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5EFC1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA799FB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA799DAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA799AB2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA79989D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA799680000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7992D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA79A1B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7992f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:58:47.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T22:59:47.075+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] MongoDB starting : pid=10606 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] modules: none 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] build environment: 2017-10-12T22:59:47.082+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T22:59:47.083+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T22:59:47.083+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T22:59:47.132+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T22:59:47.387+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849187:387648][10606:0x7f3f64488c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T22:59:47.387+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T22:59:47.398+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f633b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F63397000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9007F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F6406F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F63E6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F63B71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F6395C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F6373F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F63397000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F64278000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f633b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T22:59:47.398+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:00:47.529+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] MongoDB starting : pid=10846 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:00:47.537+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:00:47.588+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:00:47.912+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849247:912179][10846:0x7fea34b16c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:00:47.912+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:00:47.922+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea33a46635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA33A25000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA346FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA344F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA341FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA33FEA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA33DCD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA33A25000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA34906000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea33a46635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:00:47.922+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:01:47.375+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] MongoDB starting : pid=11053 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:01:47.384+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:01:47.434+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:01:47.823+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849307:823918][11053:0x7f0fffc56c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:01:47.824+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:01:47.843+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ffeb86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FFEB65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FFF83D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FFF639000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FFF33F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FFF12A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FFEF0D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FFEB65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FFFA46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ffeb86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:01:47.843+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:02:47.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] MongoDB starting : pid=11218 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:02:47.499+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:02:47.550+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:02:47.917+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849367:917961][11218:0x7f84b66f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:02:47.918+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:02:47.937+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f84b5627635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F84B5606000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B4C7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84B62DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84B60DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84B5DE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F84B5BCB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84B59AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F84B5606000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F84B64E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f84b5627635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:02:47.937+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:03:47.082+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:03:47.089+0000 I CONTROL [initandlisten] MongoDB starting : pid=11477 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:03:47.090+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:03:47.139+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:03:47.411+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849427:411290][11477:0x7f57b0031c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:03:47.411+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:03:47.430+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f57aef61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F57AEF40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A349000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F57AFC18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F57AFA14000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F57AF71A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F57AF505000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F57AF2E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F57AEF40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F57AFE21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f57aef61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:03:47.430+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:04:47.559+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] MongoDB starting : pid=11710 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:04:47.567+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:04:47.618+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:04:47.882+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849487:882544][11710:0x7f28dc98fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:04:47.882+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:04:47.893+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28db8bf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28DB89E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28DC576000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28DC372000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28DC078000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F28DBE63000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28DBC46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28DB89E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28DC77F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28db8bf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:04:47.893+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:05:48.011+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:05:48.018+0000 I CONTROL [initandlisten] MongoDB starting : pid=11938 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:05:48.018+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:05:48.018+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:05:48.018+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:05:48.019+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:05:48.019+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:05:48.019+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:05:48.019+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:05:48.019+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:05:48.068+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:05:48.371+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849548:371203][11938:0x7f2889cafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:05:48.371+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:05:48.390+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2888bdf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2888BBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31C30000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2889896000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2889692000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2889398000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2889183000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2888F66000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2888BBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2889A9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2888bdf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:05:48.390+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:06:47.770+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] MongoDB starting : pid=12147 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:06:47.778+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:06:47.827+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:06:48.107+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849608:107125][12147:0x7fe7a7be0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:06:48.107+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:06:48.117+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7a6b10635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7A6AEF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD0091000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7A77C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7A75C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7A72C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7A70B4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7A6E97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7A6AEF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7A79D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7a6b10635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:06:48.117+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:07:47.250+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] MongoDB starting : pid=12304 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:07:47.258+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:07:47.307+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:07:47.679+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849667:679594][12304:0x7f8e9243ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:07:47.679+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:07:47.698+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e9136a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E91349000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF44ECB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E92021000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E91E1D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E91B23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E9190E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E916F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E91349000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E9222A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e9136a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:07:47.698+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:08:47.289+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] MongoDB starting : pid=12572 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:08:47.296+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:08:47.332+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:08:47.645+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849727:645135][12572:0x7f75a97e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:08:47.645+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:08:47.658+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f75a8713635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F75A86F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F75A93CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F75A91C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F75A8ECC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F75A8CB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F75A8A9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F75A86F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F75A95D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f75a8713635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:08:47.658+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:09:47.782+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:09:47.789+0000 I CONTROL [initandlisten] MongoDB starting : pid=12804 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:09:47.790+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:09:47.839+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:09:48.118+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849788:118136][12804:0x7f9d3e135c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:09:48.118+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:09:48.128+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d3d065635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D3D044000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D3DD1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D3DB18000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D3D81E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D3D609000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D3D3EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D3D044000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D3DF25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d3d065635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:09:48.128+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:10:47.249+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] MongoDB starting : pid=13034 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:10:47.257+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:10:47.307+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:10:47.704+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849847:704567][13034:0x7f45cfc58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:10:47.704+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:10:47.723+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45ceb88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45CEB67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9E63000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45CF83F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45CF63B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45CF341000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F45CF12C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F45CEF0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45CEB67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45CFA48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45ceb88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:10:47.723+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:11:47.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=13244 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:11:47.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:11:47.201+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:11:47.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849907:559553][13244:0x7fbf8a9c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:11:47.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:11:47.570+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbf898f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBF898D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD14FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBF8A5AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBF8A3A9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBF8A0AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBF89E9A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBF89C7D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBF898D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBF8A7B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbf898f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:11:47.570+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:12:47.694+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] MongoDB starting : pid=13406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:12:47.702+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:12:47.753+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:12:48.122+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507849968:122875][13406:0x7f58ae24cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:12:48.122+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:12:48.134+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58ad17c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58AD15B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF200FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58ADE33000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58ADC2F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58AD935000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58AD720000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58AD503000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58AD15B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58AE03C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58ad17c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:12:48.134+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:13:47.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] MongoDB starting : pid=13685 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:13:47.431+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:13:47.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:13:47.882+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850027:882104][13685:0x7f8ff2fcec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:13:47.882+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:13:47.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ff1efe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8FF1EDD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8FF2BB5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8FF29B1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8FF26B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8FF24A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8FF2285000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8FF1EDD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8FF2DBE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ff1efe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:13:47.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:14:48.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] MongoDB starting : pid=13920 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:14:48.043+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:14:48.093+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:14:48.352+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850088:352051][13920:0x7fa106de1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:14:48.352+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:14:48.362+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa105d11635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA105CF0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1069C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1067C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1064CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1062B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA106098000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA105CF0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA106BD1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa105d11635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:14:48.362+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:15:47.489+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] MongoDB starting : pid=14143 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:15:47.497+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:15:47.553+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:15:47.852+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850147:852893][14143:0x7f6b97e93c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:15:47.852+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:15:47.864+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b96dc3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B96DA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B97A7A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B97876000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B9757C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B97367000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B9714A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B96DA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B97C83000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b96dc3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:15:47.864+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:16:47.254+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] MongoDB starting : pid=14352 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:16:47.262+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:16:47.312+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:16:47.681+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850207:681159][14352:0x7f2fe995ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:16:47.681+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:16:47.700+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2fe888a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FE8869000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAF8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FE9541000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FE933D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FE9043000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FE8E2E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FE8C11000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FE8869000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FE974A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2fe888a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:16:47.700+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:17:47.833+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] MongoDB starting : pid=14818 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:17:47.840+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:17:47.889+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:17:48.147+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850268:147602][14818:0x7f465e516c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:17:48.147+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:17:48.158+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f465d446635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F465D425000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF012F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F465E0FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F465DEF9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F465DBFF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F465D9EA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F465D7CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F465D425000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F465E306000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f465d446635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:17:48.158+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:18:47.595+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:18:47.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=15122 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:18:47.603+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:18:47.653+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:18:47.984+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850327:984640][15122:0x7ffcc5540c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:18:47.984+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:18:47.996+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffcc4470635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFCC444F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90CD4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFCC5127000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFCC4F23000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFCC4C29000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFCC4A14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFCC47F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFCC444F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFCC5330000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffcc4470635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:18:47.996+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:19:47.130+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] MongoDB starting : pid=15268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:19:47.138+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:19:47.190+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:19:47.497+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850387:497092][15268:0x7fca21769c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:19:47.497+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:19:47.516+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca20699635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA20678000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA21350000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA2114C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA20E52000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA20C3D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA20A20000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA20678000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA21559000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca20699635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:19:47.516+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:20:47.633+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] MongoDB starting : pid=15508 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:20:47.640+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:20:47.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:20:47.960+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850447:960201][15508:0x7f3eda96bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:20:47.960+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:20:47.980+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3ed989b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3ED987A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3EDA552000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3EDA34E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3EDA054000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3ED9E3F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3ED9C22000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3ED987A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3EDA75B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3ed989b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:20:47.980+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:21:47.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] MongoDB starting : pid=15714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:21:47.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:21:47.502+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:21:47.887+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850507:886990][15714:0x7fba7d0fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:21:47.887+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:21:47.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba7c02a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA7C009000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA7CCE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA7CADD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA7C7E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA7C5CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA7C3B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA7C009000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA7CEEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba7c02a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:21:47.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:22:48.055+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:22:48.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=15952 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:22:48.067+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:22:48.112+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:22:48.354+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850568:354288][15952:0x7fcd0e9a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:22:48.354+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:22:48.365+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd0d8d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD0D8B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD0E58A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD0E386000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD0E08C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD0DE77000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD0DC5A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD0D8B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD0E793000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd0d8d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:22:48.365+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:23:47.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=16083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:23:47.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:23:47.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:23:48.260+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850628:260587][16083:0x7fd890f65c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:23:48.260+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:23:48.281+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd88fe95635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD88FE74000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF806FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD890B4C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD890948000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD89064E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD890439000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD89021C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD88FE74000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD890D55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd88fe95635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:23:48.281+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:24:47.418+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] MongoDB starting : pid=16367 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:24:47.426+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:24:47.478+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:24:47.851+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850687:851399][16367:0x7f79baf98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:24:47.851+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:24:47.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f79b9ec8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79B9EA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79BAB7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79BA97B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79BA681000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F79BA46C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F79BA24F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79B9EA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79BAD88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f79b9ec8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:24:47.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:25:48.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:25:48.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=16595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:25:48.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:25:48.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:25:48.331+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850748:331782][16595:0x7ff68f69bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:25:48.331+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:25:48.342+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff68e5cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF68E5AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FDE1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF68F282000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF68F07E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF68ED84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF68EB6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF68E952000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF68E5AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF68F48B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff68e5cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:25:48.342+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:26:47.800+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] MongoDB starting : pid=16820 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:26:47.807+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:26:47.857+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:26:48.150+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850808:150073][16820:0x7f3e121dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:26:48.150+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:26:48.161+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e1110e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E110ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C601000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E11DC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E11BC1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E118C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E116B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E11495000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E110ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E11FCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e1110e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:26:48.161+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:27:47.291+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] MongoDB starting : pid=17056 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:27:47.298+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:27:47.348+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:27:47.642+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850867:642532][17056:0x7f266a9a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:27:47.642+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:27:47.653+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f26698d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F26698B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A6E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F266A58C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F266A388000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F266A08E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2669E79000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2669C5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F26698B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F266A795000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f26698d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:27:47.653+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:28:47.130+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] MongoDB starting : pid=17196 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:28:47.140+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:28:47.191+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:28:47.519+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850927:519355][17196:0x7f6bcb964c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:28:47.519+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:28:47.529+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6bca894635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6BCA873000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000008FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6BCB54B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6BCB347000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6BCB04D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6BCAE38000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6BCAC1B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6BCA873000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6BCB754000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6bca894635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:28:47.529+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:29:47.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] MongoDB starting : pid=17483 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:29:47.676+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:29:47.727+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:29:48.014+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507850988:14026][17483:0x7f2c869f8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:29:48.014+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:29:48.024+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c85928635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C85907000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8EE0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C865DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C863DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C860E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C85ECC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C85CAF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C85907000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C867E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c85928635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:29:48.024+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:30:47.148+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] MongoDB starting : pid=17716 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:30:47.156+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:30:47.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:30:47.516+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851047:516625][17716:0x7f337465cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:30:47.516+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:30:47.527+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f337358c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F337356B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF558D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3374243000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F337403F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3373D45000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3373B30000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3373913000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F337356B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F337444C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f337358c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:30:47.527+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:31:47.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=17918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:31:47.998+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:31:48.048+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:31:48.363+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851108:363938][17918:0x7f2b630abc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:31:48.364+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:31:48.375+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b61fdb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B61FBA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25217000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B62C92000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B62A8E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B62794000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B6257F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B62362000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B61FBA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B62E9B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b61fdb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:31:48.375+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:32:47.499+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] MongoDB starting : pid=18154 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:32:47.507+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:32:47.557+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:32:47.826+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851167:826422][18154:0x7f7ffcd45c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:32:47.826+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:32:47.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ffbc75635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7FFBC54000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7FFC92C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7FFC728000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7FFC42E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7FFC219000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7FFBFFC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7FFBC54000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7FFCB35000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ffbc75635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:32:47.837+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:33:47.398+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=18285 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:33:47.406+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:33:47.456+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:33:47.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851227:782040][18285:0x7f1f3ab9dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:33:47.782+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:33:47.801+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f39acd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F39AAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F682000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F3A784000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F3A580000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F3A286000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F3A071000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F39E54000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F39AAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F3A98D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f39acd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:33:47.801+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:34:47.926+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] MongoDB starting : pid=18570 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:34:47.935+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:34:47.985+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:34:48.320+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851288:320794][18570:0x7fda87dcfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:34:48.320+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:34:48.331+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda86cff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA86CDE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC405000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA879B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA877B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA874B8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA872A3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA87086000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA86CDE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA87BBF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda86cff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:34:48.331+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:35:47.458+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] MongoDB starting : pid=18795 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:35:47.465+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:35:47.466+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:35:47.516+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:35:47.796+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851347:796164][18795:0x7f43781a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:35:47.796+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:35:47.806+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f43770d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F43770B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF466FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4377D8A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4377B86000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F437788C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4377677000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F437745A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F43770B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4377F93000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f43770d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:35:47.806+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:36:47.251+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] MongoDB starting : pid=19009 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:36:47.259+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:36:47.311+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:36:47.703+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851407:703563][19009:0x7f9486a87c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:36:47.703+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:36:47.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94859b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9485996000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43CBF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F948666E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F948646A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9486170000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9485F5B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9485D3E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9485996000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9486877000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94859b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:36:47.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:37:47.844+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:37:47.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=19244 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:37:47.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:37:47.903+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:37:48.282+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851468:282473][19244:0x7fab6aa5ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:37:48.282+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:37:48.302+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fab6998a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAB69969000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF054FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAB6A641000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB6A43D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB6A143000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB69F2E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB69D11000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB69969000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB6A84A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fab6998a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:37:48.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:38:47.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] MongoDB starting : pid=19377 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:38:47.629+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:38:47.681+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:38:48.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851528:61994][19377:0x7f72bcbf8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:38:48.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:38:48.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f72bbb28635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F72BBB07000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62A86000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F72BC7DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F72BC5DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F72BC2E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F72BC0CC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F72BBEAF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F72BBB07000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F72BC9E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f72bbb28635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:38:48.081+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:39:47.210+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:39:47.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=19664 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:39:47.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:39:47.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:39:47.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:39:47.217+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:39:47.217+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:39:47.218+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:39:47.218+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:39:47.218+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:39:47.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:39:47.535+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851587:535488][19664:0x7f3c1dcf4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:39:47.535+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:39:47.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c1cc24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C1CC03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA679000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C1D8DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C1D6D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C1D3DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C1D1C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C1CFAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C1CC03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C1DAE4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c1cc24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:39:47.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:40:47.680+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] MongoDB starting : pid=19885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:40:47.691+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:40:47.746+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:40:48.089+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851648:89947][19885:0x7f4b435dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:40:48.090+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:40:48.100+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b4250b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B424EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFB4E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B431C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B42FBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B42CC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B42AAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B42892000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B424EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B433CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b4250b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:40:48.100+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:41:47.517+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=20109 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:41:47.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:41:47.577+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:41:47.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851707:910238][20109:0x7f353d854c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:41:47.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:41:47.930+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f353c784635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F353C763000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F353D43B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F353D237000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F353CF3D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F353CD28000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F353CB0B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F353C763000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F353D644000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f353c784635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:41:47.930+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:42:47.050+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] MongoDB starting : pid=20347 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:42:47.058+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:42:47.109+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:42:47.506+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851767:506542][20347:0x7fc32c2fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:42:47.506+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:42:47.526+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc32b22e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC32B20D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC32BEE5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC32BCE1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC32B9E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC32B7D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC32B5B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC32B20D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC32C0EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc32b22e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:42:47.526+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:43:48.039+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] MongoDB starting : pid=20495 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:43:48.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:43:48.098+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:43:48.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851828:408138][20495:0x7fabc4c8ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:43:48.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:43:48.418+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabc3bba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABC3B99000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABC4871000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABC466D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABC4373000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABC415E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABC3F41000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABC3B99000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABC4A7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabc3bba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:43:48.418+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:44:47.543+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] MongoDB starting : pid=20773 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:44:47.554+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:44:47.610+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:44:47.902+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851887:902547][20773:0x7fd1bcb89c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:44:47.902+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:44:47.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd1bbab9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD1BBA98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD1BC770000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD1BC56C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD1BC272000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD1BC05D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD1BBE40000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD1BBA98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD1BC979000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd1bbab9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:44:47.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:45:48.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:45:48.041+0000 I CONTROL [initandlisten] MongoDB starting : pid=21011 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:45:48.041+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:45:48.041+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:45:48.041+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:45:48.042+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:45:48.042+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:45:48.042+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:45:48.042+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:45:48.042+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:45:48.092+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:45:48.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507851948:410362][21011:0x7f67442afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:45:48.410+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:45:48.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67431df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67431BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6743E96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6743C92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6743998000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6743783000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6743566000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67431BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F674409F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67431df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:45:48.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:46:47.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=21234 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:46:47.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:46:47.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:46:48.266+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852008:266743][21234:0x7fa7e1288c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:46:48.266+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:46:48.278+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7e01b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7E0197000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7E0E6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7E0C6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7E0971000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7E075C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7E053F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7E0197000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7E1078000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7e01b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:46:48.278+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:47:47.408+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] MongoDB starting : pid=21471 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:47:47.415+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:47:47.468+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:47:47.803+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852067:803434][21471:0x7fa655559c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:47:47.803+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:47:47.823+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa654489635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA654468000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF72AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA655140000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA654F3C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA654C42000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA654A2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA654810000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA654468000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA655349000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa654489635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:47:47.823+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:48:47.229+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] MongoDB starting : pid=21607 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:48:47.236+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:48:47.286+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:48:47.625+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852127:625814][21607:0x7f9848a2dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:48:47.625+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:48:47.645+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f984795d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F984793C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8FE27000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9848614000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9848410000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9848116000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9847F01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9847CE4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F984793C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F984881D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f984795d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:48:47.645+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:49:47.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=21892 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:49:47.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:49:47.824+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:49:48.136+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852188:136841][21892:0x7f1962f38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:49:48.136+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:49:48.149+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1961e68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1961E47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1962B1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F196291B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1962621000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F196240C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19621EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1961E47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1962D28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1961e68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:49:48.149+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:50:47.269+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] MongoDB starting : pid=22096 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:50:47.276+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:50:47.325+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:50:47.581+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852247:581573][22096:0x7f65bd070c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:50:47.581+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:50:47.592+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65bbfa0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65BBF7F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65BCC57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65BCA53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65BC759000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65BC544000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65BC327000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65BBF7F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65BCE60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65bbfa0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:50:47.592+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:51:47.973+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] MongoDB starting : pid=22335 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:51:47.981+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:51:48.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:51:48.329+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852308:329943][22335:0x7f499013ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:51:48.330+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:51:48.350+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f498f06e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F498F04D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B084000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F498FD25000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F498FB21000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F498F827000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F498F612000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F498F3F5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F498F04D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F498FF2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f498f06e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:51:48.350+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:52:47.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] MongoDB starting : pid=22565 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:52:47.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:52:47.529+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:52:47.884+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852367:884840][22565:0x7f68b945dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:52:47.884+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:52:47.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68b838d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68B836C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF778E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68B9044000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68B8E40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68B8B46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68B8931000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68B8714000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68B836C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68B924D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68b838d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:52:47.904+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:53:47.332+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] MongoDB starting : pid=22702 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:53:47.339+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:53:47.340+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:53:47.390+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:53:47.715+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852427:715543][22702:0x7f8b701b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:53:47.715+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:53:47.726+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b6f0e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B6F0C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD262C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B6FD9C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B6FB98000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B6F89E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B6F689000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B6F46C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B6F0C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B6FFA5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b6f0e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:53:47.726+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:54:47.869+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] MongoDB starting : pid=22955 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:54:47.877+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:54:47.927+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:54:48.288+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852488:288304][22955:0x7fe849ea6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:54:48.288+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:54:48.299+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe848dd6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE848DB5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE849A8D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE849889000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE84958F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE84937A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE84915D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE848DB5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE849C96000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe848dd6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:54:48.299+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:55:47.422+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] MongoDB starting : pid=23094 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:55:47.430+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:55:47.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:55:47.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852547:828030][23094:0x7f767be22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:55:47.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:55:47.838+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f767ad52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F767AD31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F767BA09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F767B805000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F767B50B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F767B2F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F767B0D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F767AD31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F767BC12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f767ad52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:55:47.838+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:56:47.227+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] MongoDB starting : pid=23328 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:56:47.235+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:56:47.286+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:56:47.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852607:643818][23328:0x7f3f54ffdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:56:47.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:56:47.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3f53f2d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3F53F0C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48274000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3F54BE4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3F549E0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3F546E6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3F544D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3F542B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3F53F0C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3F54DED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3f53f2d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:56:47.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:57:47.788+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] MongoDB starting : pid=23555 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:57:47.796+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:57:47.847+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:57:48.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852668:152033][23555:0x7ff9e569fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:57:48.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:57:48.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9e45cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9E45AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF530FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF9E5286000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9E5082000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9E4D88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9E4B73000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF9E4956000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9E45AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9E548F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9e45cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:57:48.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:58:47.474+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] MongoDB starting : pid=23793 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:58:47.483+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:58:47.533+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:58:47.814+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852727:814653][23793:0x7f78f341cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:58:47.814+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:58:47.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f78f234c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78F232B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCDEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78F3003000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78F2DFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78F2B05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78F28F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78F26D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78F232B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78F320C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f78f234c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:58:47.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-12T23:59:47.962+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] MongoDB starting : pid=23939 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] modules: none 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] build environment: 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-12T23:59:47.970+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-12T23:59:48.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-12T23:59:48.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852788:305924][23939:0x7f533358ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-12T23:59:48.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-12T23:59:48.316+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53324be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F533249D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5333175000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5332F71000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5332C77000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5332A62000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5332845000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F533249D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F533337E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53324be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-12T23:59:48.316+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:00:47.597+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] MongoDB starting : pid=24245 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:00:47.605+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:00:47.657+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:00:47.943+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852847:943151][24245:0x7f34df9b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:00:47.943+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:00:47.953+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f34de8e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F34DE8C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE59F4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F34DF59D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34DF399000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34DF09F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F34DEE8A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F34DEC6D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34DE8C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34DF7A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f34de8e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:00:47.953+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:01:47.349+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] MongoDB starting : pid=24479 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:01:47.357+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:01:47.407+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:01:47.793+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852907:793757][24479:0x7ffc2510ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:01:47.793+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:01:47.813+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc2403a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC24019000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC24CF1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC24AED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC247F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC245DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC243C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC24019000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC24EFA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc2403a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:01:47.813+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:02:47.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] MongoDB starting : pid=25190 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:02:47.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:02:47.849+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:02:48.163+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507852968:163027][25190:0x7f4b1c5e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:02:48.163+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:02:48.174+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b1b510635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B1B4EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF160B6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B1C1C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B1BFC3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B1BCC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B1BAB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B1B897000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B1B4EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B1C3D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b1b510635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:02:48.174+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:03:47.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] MongoDB starting : pid=25445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:03:47.871+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:03:47.921+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:03:48.246+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853028:246312][25445:0x7f2abd893c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:03:48.246+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:03:48.257+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2abc7c3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2ABC7A2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF642FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2ABD47A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2ABD276000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2ABCF7C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2ABCD67000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2ABCB4A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2ABC7A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2ABD683000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2abc7c3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:03:48.257+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:04:47.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] MongoDB starting : pid=25594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:04:47.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:04:47.439+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:04:47.771+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853087:771766][25594:0x7fdfb8556c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:04:47.771+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:04:47.792+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdfb7486635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFB7465000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8A75000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFB813D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFB7F39000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFB7C3F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFB7A2A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFB780D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFB7465000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFB8346000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdfb7486635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:04:47.792+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:05:47.927+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] MongoDB starting : pid=25856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:05:47.934+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:05:47.984+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:05:48.295+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853148:295749][25856:0x7fc1d7c21c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:05:48.295+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:05:48.316+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1d6b51635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1D6B30000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC1D7808000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC1D7604000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC1D730A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1D70F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC1D6ED8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1D6B30000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1D7A11000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1d6b51635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:05:48.316+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:06:47.731+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] MongoDB starting : pid=26090 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:06:47.739+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:06:47.789+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:06:48.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853208:70372][26090:0x7f08cc2f0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:06:48.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:06:48.080+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f08cb220635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F08CB1FF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF688FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F08CBED7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F08CBCD3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F08CB9D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F08CB7C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F08CB5A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F08CB1FF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F08CC0E0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f08cb220635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:06:48.080+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:07:47.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] MongoDB starting : pid=26304 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:07:47.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:07:47.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:07:47.610+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853267:610296][26304:0x7fa6b2ff8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:07:47.610+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:07:47.620+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6b1f28635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6B1F07000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6B2BDF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6B29DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6B26E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6B24CC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6B22AF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6B1F07000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6B2DE8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6b1f28635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:07:47.620+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:08:47.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=26542 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:08:47.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:08:47.392+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:08:47.699+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853327:699844][26542:0x7fe3db8f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:08:47.699+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:08:47.710+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe3da829635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE3DA808000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE3DB4E0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE3DB2DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE3DAFE2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE3DADCD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE3DABB0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE3DA808000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE3DB6E9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe3da829635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:08:47.710+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:09:47.830+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] MongoDB starting : pid=26688 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:09:47.838+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:09:47.887+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:09:48.240+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853388:240637][26688:0x7f395cb98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:09:48.240+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:09:48.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f395bac8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F395BAA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F395C77F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F395C57B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F395C281000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F395C06C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F395BE4F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F395BAA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F395C988000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f395bac8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:09:48.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:10:47.386+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] MongoDB starting : pid=26936 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:10:47.394+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:10:47.445+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:10:47.772+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853447:772034][26936:0x7f2548237c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:10:47.772+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:10:47.782+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2547167635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2547146000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9DCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2547E1E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2547C1A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2547920000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F254770B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25474EE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2547146000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2548027000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2547167635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:10:47.782+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:11:47.165+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=27171 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:11:47.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:11:47.225+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:11:47.553+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853507:553242][27171:0x7f9b9bde8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:11:47.553+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:11:47.565+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b9ad18635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B9ACF7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C6DE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B9B9CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B9B7CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B9B4D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B9B2BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B9B09F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B9ACF7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B9BBD8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b9ad18635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:11:47.565+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:12:47.694+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] MongoDB starting : pid=27477 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:12:47.703+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:12:47.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:12:48.045+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853568:45735][27477:0x7fa6e7033c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:12:48.045+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:12:48.057+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6e5f63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6E5F42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF966FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6E6C1A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6E6A16000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6E671C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6E6507000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6E62EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6E5F42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6E6E23000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6e5f63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:12:48.057+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:13:48.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=27719 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:13:48.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:13:48.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:13:48.458+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853628:458365][27719:0x7feccd740c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:13:48.458+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:13:48.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feccc670635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECCC64F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF800FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECCD327000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECCD123000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECCCE29000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECCCC14000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECCC9F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECCC64F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FECCD530000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feccc670635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:13:48.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:14:47.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] MongoDB starting : pid=27866 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:14:47.612+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:14:47.665+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:14:47.999+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853687:999020][27866:0x7fa397cbcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:14:47.999+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:14:48.009+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa396bec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA396BCB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8BC6C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3978A3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA39769F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3973A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA397190000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA396F73000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA396BCB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA397AAC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa396bec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:14:48.009+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:15:47.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] MongoDB starting : pid=28144 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:15:47.149+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:15:47.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:15:47.498+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853747:498941][28144:0x7f0973463c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:15:47.499+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:15:47.524+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0972393635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0972372000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF578F7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F097304A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0972E46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0972B4C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0972937000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F097271A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0972372000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0973253000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0972393635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:15:47.524+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:16:47.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] MongoDB starting : pid=28387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:16:47.899+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:16:47.949+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:16:48.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853808:274823][28387:0x7f698ced4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:16:48.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:16:48.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f698be04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F698BDE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB2BF7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F698CABB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F698C8B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F698C5BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F698C3A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F698C18B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F698BDE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F698CCC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f698be04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:16:48.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:17:47.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] MongoDB starting : pid=28607 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:17:47.430+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:17:47.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:17:47.848+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853867:848379][28607:0x7fbd87cd9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:17:47.848+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:17:47.868+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbd86c09635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBD86BE8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBD878C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBD876BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBD873C2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBD871AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBD86F90000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBD86BE8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBD87AC9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbd86c09635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:17:47.868+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:18:47.999+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] MongoDB starting : pid=28855 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:18:48.006+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:18:48.057+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:18:48.340+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853928:340092][28855:0x7f220c798c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:18:48.340+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:18:48.350+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f220b6c8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F220B6A7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10CFA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F220C37F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F220C17B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F220BE81000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F220BC6C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F220BA4F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F220B6A7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F220C588000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f220b6c8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:18:48.350+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:19:47.487+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=28988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:19:47.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:19:47.495+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:19:47.495+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:19:47.544+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:19:47.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507853987:846675][28988:0x7f7f59720c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:19:47.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:19:47.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f58650635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F5862F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF88FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F59307000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F59103000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F58E09000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F58BF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F589D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F5862F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F59510000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f58650635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:19:47.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:20:47.990+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] MongoDB starting : pid=29253 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:20:47.997+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:20:48.048+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:20:48.413+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854048:413439][29253:0x7f2779745c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:20:48.413+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:20:48.433+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2778675635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2778654000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF804FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F277932C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2779128000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2778E2E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2778C19000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F27789FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2778654000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2779535000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2778675635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:20:48.433+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:21:47.874+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:21:47.884+0000 I CONTROL [initandlisten] MongoDB starting : pid=29487 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:21:47.885+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:21:47.944+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:21:48.228+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854108:228263][29487:0x7f728c71ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:21:48.228+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:21:48.238+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f728b64e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F728B62D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F728C305000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F728C101000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F728BE07000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F728BBF2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F728B9D5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F728B62D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F728C50E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f728b64e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:21:48.238+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:22:47.365+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] MongoDB starting : pid=29693 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:22:47.372+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:22:47.421+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:22:47.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854167:741689][29693:0x7f68022e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:22:47.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:22:47.761+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6801211635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68011F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60C8B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6801EC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6801CC4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68019CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68017B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6801598000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68011F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68020D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6801211635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:22:47.761+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:23:47.886+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] MongoDB starting : pid=29940 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:23:47.893+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:23:47.943+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:23:48.313+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854228:313647][29940:0x7f7d0fd02c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:23:48.313+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:23:48.332+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d0ec32635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D0EC11000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF78E0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D0F8E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D0F6E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D0F3EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D0F1D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D0EFB9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D0EC11000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D0FAF2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d0ec32635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:23:48.333+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:24:47.610+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:24:47.617+0000 I CONTROL [initandlisten] MongoDB starting : pid=30068 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:24:47.617+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:24:47.618+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:24:47.668+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:24:47.957+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854287:957147][30068:0x7fcbea7bfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:24:47.957+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:24:47.967+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbe96ef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBE96CE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBC58000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBEA3A6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBEA1A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBE9EA8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBE9C93000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBE9A76000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBE96CE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBEA5AF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbe96ef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:24:47.967+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:25:47.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] MongoDB starting : pid=30336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:25:47.097+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:25:47.147+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:25:47.483+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854347:483339][30336:0x7ffedc73ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:25:47.483+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:25:47.493+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffedb66a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFEDB649000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF554FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFEDC321000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFEDC11D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFEDBE23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFEDBC0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFEDB9F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFEDB649000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFEDC52A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffedb66a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:25:47.493+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:26:47.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] MongoDB starting : pid=30571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:26:47.903+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:26:47.953+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:26:48.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854408:296847][30571:0x7f4e7956cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:26:48.296+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:26:48.307+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e7849c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E7847B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E79153000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E78F4F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E78C55000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E78A40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E78823000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E7847B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E7935C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e7849c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:26:48.307+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:27:47.431+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:27:47.438+0000 I CONTROL [initandlisten] MongoDB starting : pid=30777 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:27:47.438+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:27:47.439+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:27:47.489+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:27:47.830+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854467:830861][30777:0x7f5634fd4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:27:47.830+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:27:47.850+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5633f04635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5633EE3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5634BBB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56349B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56346BD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56344A8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F563428B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5633EE3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5634DC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5633f04635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:27:47.850+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:28:47.975+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] MongoDB starting : pid=31057 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:28:47.983+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:28:48.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:28:48.346+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854528:346152][31057:0x7f16b767ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:28:48.346+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:28:48.357+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16b65ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16B658D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF848FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F16B7265000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F16B7061000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F16B6D67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F16B6B52000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F16B6935000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16B658D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F16B746E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16b65ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:28:48.357+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:29:47.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] MongoDB starting : pid=31178 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:29:47.822+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:29:47.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:29:48.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854588:152484][31178:0x7fb4f1c69c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:29:48.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:29:48.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb4f0b99635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB4F0B78000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0090000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB4F1850000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB4F164C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB4F1352000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB4F113D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB4F0F20000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB4F0B78000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB4F1A59000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb4f0b99635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:29:48.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:30:47.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=31322 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:30:47.294+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:30:47.345+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:30:47.728+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854647:728288][31322:0x7f05dd31cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:30:47.728+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:30:47.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f05dc24c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F05DC22B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF944FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F05DCF03000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F05DCCFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F05DCA05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F05DC7F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F05DC5D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F05DC22B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F05DD10C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f05dc24c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:30:47.748+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:31:47.200+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=31623 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:31:47.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:31:47.259+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:31:47.585+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854707:585620][31623:0x7f7ec06f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:31:47.585+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:31:47.598+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ebf626635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EBF605000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC21A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EC02DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EC00D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EBFDDF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EBFBCA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EBF9AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EBF605000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EC04E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ebf626635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:31:47.598+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:32:47.718+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] MongoDB starting : pid=31840 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:32:47.725+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:32:47.775+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:32:48.099+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854768:98996][31840:0x7f29d3bd0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:32:48.099+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:32:48.118+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29d2b00635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29D2ADF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29D37B7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29D35B3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29D32B9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29D30A4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29D2E87000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29D2ADF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29D39C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29d2b00635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:32:48.118+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:33:47.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] MongoDB starting : pid=32084 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:33:47.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:33:47.295+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:33:47.604+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854827:604848][32084:0x7f6e0ed1dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:33:47.604+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:33:47.615+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e0dc4d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E0DC2C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E0E904000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E0E700000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E0E406000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E0E1F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E0DFD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E0DC2C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E0EB0D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e0dc4d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:33:47.615+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:34:47.979+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] MongoDB starting : pid=32282 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:34:47.986+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:34:48.037+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:34:48.339+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854888:339106][32282:0x7fb442c89c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:34:48.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:34:48.349+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb441bb9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB441B98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF856C1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB442870000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB44266C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB442372000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB44215D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB441F40000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB441B98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB442A79000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb441bb9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:34:48.349+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:35:47.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=32425 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:35:47.477+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:35:47.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:35:47.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507854947:783728][32425:0x7f2a23b80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:35:47.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:35:47.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2a22ab0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2A22A8F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2A23767000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2A23563000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2A23269000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2A23054000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2A22E37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2A22A8F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2A23970000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2a22ab0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:35:47.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:36:47.236+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] MongoDB starting : pid=32711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:36:47.243+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:36:47.293+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:36:47.598+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855007:598086][32711:0x7f328439ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:36:47.598+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:36:47.610+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32832ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F32832AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF330FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3283F85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3283D81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3283A87000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3283872000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3283655000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F32832AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F328418E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32832ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:36:47.610+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:37:47.739+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] MongoDB starting : pid=450 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:37:47.746+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:37:47.796+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:37:48.168+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855068:168375][450:0x7fd466830c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:37:48.168+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:37:48.188+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd465760635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD46573F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B2DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD466417000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD466213000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD465F19000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD465D04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD465AE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD46573F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD466620000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd465760635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:37:48.188+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:38:47.323+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=697 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:38:47.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:38:47.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:38:47.727+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855127:727341][697:0x7fae89ea8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:38:47.727+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:38:47.739+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fae88dd8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAE88DB7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAE89A8F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAE8988B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAE89591000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAE8937C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAE8915F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAE88DB7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAE89C98000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fae88dd8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:38:47.739+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:39:47.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] MongoDB starting : pid=895 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:39:47.627+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:39:47.677+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:39:47.979+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855187:979218][895:0x7f65b5f04c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:39:47.979+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:39:47.989+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65b4e34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65B4E13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65B5AEB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65B58E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65B55ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65B53D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65B51BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65B4E13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65B5CF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65b4e34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:39:47.989+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:40:47.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] MongoDB starting : pid=1043 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:40:47.121+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:40:47.171+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:40:47.510+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855247:510170][1043:0x7fe103a0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:40:47.510+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:40:47.520+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe10293a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE102919000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1035F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1033ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1030F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE102EDE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE102CC1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE102919000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1037FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe10293a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:40:47.520+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:41:47.910+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] MongoDB starting : pid=1333 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:41:47.917+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:41:47.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:41:48.344+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855308:344793][1333:0x7f15569e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:41:48.344+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:41:48.364+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1555918635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15558F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF366FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15565CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15563CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15560D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1555EBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1555C9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15558F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15567D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1555918635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:41:48.364+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:42:47.478+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:42:47.485+0000 I CONTROL [initandlisten] MongoDB starting : pid=1543 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:42:47.486+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:42:47.537+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:42:47.851+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855367:851207][1543:0x7f2b18d3ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:42:47.851+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:42:47.862+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b17c6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B17C4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B18925000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B18721000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B18427000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B18212000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B17FF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B17C4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B18B2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b17c6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:42:47.862+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:43:47.988+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] MongoDB starting : pid=1807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:43:47.996+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:43:48.046+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:43:48.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855428:306750][1807:0x7f3299034c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:43:48.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:43:48.317+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3297f64635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3297F43000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC41DE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3298C1B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3298A17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F329871D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3298508000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F32982EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3297F43000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3298E24000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3297f64635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:43:48.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:44:47.057+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=2010 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:44:47.065+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:44:47.114+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:44:47.414+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855487:414730][2010:0x7feb3db8cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:44:47.414+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:44:47.434+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feb3cabc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEB3CA9B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEB3D773000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB3D56F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB3D275000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB3D060000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB3CE43000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB3CA9B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB3D97C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feb3cabc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:44:47.434+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:45:47.569+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:45:47.577+0000 I CONTROL [initandlisten] MongoDB starting : pid=2169 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:45:47.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:45:47.628+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:45:47.939+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855547:939937][2169:0x7fcfa01dcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:45:47.940+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:45:47.950+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf9f10c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF9F0EB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF856FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF9FDC3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF9FBBF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF9F8C5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF9F6B0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF9F493000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF9F0EB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF9FFCC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf9f10c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:45:47.950+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:46:47.371+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=2457 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:46:47.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:46:47.430+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:46:47.779+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855607:779174][2457:0x7f03982e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:46:47.779+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:46:47.798+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0397215635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F03971F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF632FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0397ECC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0397CC8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F03979CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F03977B9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F039759C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F03971F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F03980D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0397215635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:46:47.798+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:47:47.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] MongoDB starting : pid=2666 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:47:47.945+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:47:47.996+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:47:48.342+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855668:342595][2666:0x7f90f2f51c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:47:48.342+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:47:48.362+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90f1e81635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90F1E60000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "8000008FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90F2B38000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90F2934000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90F263A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90F2425000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90F2208000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90F1E60000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90F2D41000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90f1e81635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:47:48.362+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:48:47.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:48:47.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=2916 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:48:47.499+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:48:47.549+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:48:47.923+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855727:923157][2916:0x7f2f2bbd9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:48:47.923+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:48:47.942+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f2ab09635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F2AAE8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F2B7C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F2B5BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F2B2C2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F2B0AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F2AE90000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F2AAE8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F2B9C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f2ab09635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:48:47.942+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:49:47.239+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] MongoDB starting : pid=3119 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:49:47.246+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:49:47.296+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:49:47.644+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855787:644390][3119:0x7f17ae999c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:49:47.644+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:49:47.655+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f17ad8c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F17AD8A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80279000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F17AE580000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17AE37C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17AE082000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17ADE6D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17ADC50000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F17AD8A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F17AE789000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f17ad8c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:49:47.655+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:50:47.794+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:50:47.801+0000 I CONTROL [initandlisten] MongoDB starting : pid=3268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:50:47.802+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:50:47.851+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:50:48.243+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855848:243762][3268:0x7f089a230c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:50:48.243+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:50:48.263+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0899160635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F089913F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0899E17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0899C13000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0899919000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0899704000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F08994E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F089913F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F089A020000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0899160635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:50:48.263+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:51:47.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=3562 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:51:47.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:51:47.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:51:48.006+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855908:6769][3562:0x7f9a681e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:51:48.006+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:51:48.017+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a67118635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A670F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF298FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A67DCF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A67BCB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A678D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A676BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A6749F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A670F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A67FD8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a67118635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:51:48.017+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:52:47.150+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:52:47.157+0000 I CONTROL [initandlisten] MongoDB starting : pid=3768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:52:47.157+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:52:47.157+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:52:47.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:52:47.158+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:52:47.158+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:52:47.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:52:47.158+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:52:47.158+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:52:47.207+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:52:47.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507855967:490924][3768:0x7f018ef6bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:52:47.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:52:47.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f018de9b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F018DE7A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF980FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F018EB52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F018E94E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F018E654000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F018E43F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F018E222000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F018DE7A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F018ED5B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f018de9b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:52:47.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:53:47.624+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] MongoDB starting : pid=4028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:53:47.631+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:53:47.689+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:53:47.966+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856027:966591][4028:0x7ff2679c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:53:47.966+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:53:47.977+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff2668f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF2668D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD12FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF2675AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF2673A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2670AD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF266E98000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF266C7B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF2668D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF2677B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff2668f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:53:47.978+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:54:47.296+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] MongoDB starting : pid=4229 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:54:47.303+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:54:47.355+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:54:47.695+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856087:695730][4229:0x7fca326c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:54:47.695+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:54:47.706+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca315f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA315D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA3BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA322AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA320A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA31DAD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA31B98000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA3197B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA315D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA324B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca315f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:54:47.706+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:55:47.834+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] MongoDB starting : pid=4387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:55:47.841+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:55:47.892+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:55:48.251+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856148:251800][4387:0x7f0fe49e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:55:48.251+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:55:48.271+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0fe3916635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0FE38F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF936FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0FE45CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0FE43C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0FE40CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0FE3EBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0FE3C9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0FE38F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0FE47D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0fe3916635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:55:48.271+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:56:47.663+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] MongoDB starting : pid=4695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:56:47.670+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:56:47.671+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:56:47.671+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:56:47.721+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:56:48.009+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856208:9850][4695:0x7f6d177c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:56:48.009+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:56:48.021+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6d166f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6D166D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB7896000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6D173AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6D171A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6D16EAD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6D16C98000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6D16A7B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6D166D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6D175B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6d166f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:56:48.021+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:57:47.138+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] MongoDB starting : pid=4904 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:57:47.146+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:57:47.196+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:57:47.543+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856267:543400][4904:0x7f60b60d3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:57:47.543+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:57:47.554+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f60b5003635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F60B4FE2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F60B5CBA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F60B5AB6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F60B57BC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F60B55A7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F60B538A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F60B4FE2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F60B5EC3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f60b5003635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:57:47.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:58:47.674+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] MongoDB starting : pid=5379 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:58:47.682+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:58:47.735+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:58:48.109+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856328:109578][5379:0x7fdb699aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:58:48.109+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:58:48.129+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb688de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB688BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE94D4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB69595000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB69391000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB69097000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB68E82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB68C65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB688BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB6979E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb688de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:58:48.129+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T00:59:47.438+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] MongoDB starting : pid=5699 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] modules: none 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] build environment: 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T00:59:47.446+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T00:59:47.495+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T00:59:47.843+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856387:843150][5699:0x7fd2d523cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T00:59:47.843+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T00:59:47.863+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd2d416c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD2D414B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF60D8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2D4E23000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2D4C1F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2D4925000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD2D4710000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD2D44F3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD2D414B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2D502C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd2d416c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T00:59:47.863+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:00:47.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=5969 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:00:48.001+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:00:48.051+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:00:48.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856448:369994][5969:0x7f11ac688c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:00:48.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:00:48.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f11ab5b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F11AB597000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DF30000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F11AC26F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F11AC06B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F11ABD71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F11ABB5C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F11AB93F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F11AB597000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F11AC478000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f11ab5b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:00:48.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:01:47.839+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] MongoDB starting : pid=6401 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:01:47.846+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:01:47.895+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:01:48.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856508:242751][6401:0x7f99bc6e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:01:48.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:01:48.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99bb618635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99BB5F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF30CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99BC2CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99BC0CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99BBDD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99BBBBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99BB99F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99BB5F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99BC4D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99bb618635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:01:48.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:02:47.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=6659 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:02:47.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:02:48.045+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:02:48.362+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856568:362824][6659:0x7f5f8f8efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:02:48.362+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:02:48.374+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5f8e81f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5F8E7FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5F8F4D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5F8F2D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5F8EFD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5F8EDC3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5F8EBA6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5F8E7FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5F8F6DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5f8e81f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:02:48.374+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:03:47.512+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:03:47.519+0000 I CONTROL [initandlisten] MongoDB starting : pid=6926 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:03:47.520+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:03:47.570+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:03:47.965+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856627:965030][6926:0x7f7a13fdec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:03:47.965+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:03:47.984+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a12f0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A12EED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A13BC5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A139C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A136C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A134B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A13295000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A12EED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A13DCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a12f0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:03:47.984+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:04:47.651+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] MongoDB starting : pid=7048 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:04:47.660+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:04:47.712+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:04:48.094+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856688:94450][7048:0x7f6891f6ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:04:48.094+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:04:48.114+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6890e9a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6890E79000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C76F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6891B51000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F689194D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6891653000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F689143E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6891221000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6890E79000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6891D5A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6890e9a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:04:48.114+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:05:47.234+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] MongoDB starting : pid=7277 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:05:47.242+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:05:47.291+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:05:47.606+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856747:606163][7277:0x7fb20d29cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:05:47.606+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:05:47.617+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb20c1cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB20C1AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD20D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB20CE83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB20CC7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB20C985000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB20C770000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB20C553000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB20C1AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB20D08C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb20c1cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:05:47.617+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:06:47.079+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] MongoDB starting : pid=7426 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:06:47.086+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:06:47.137+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:06:47.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856807:409592][7426:0x7fda3e321c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:06:47.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:06:47.420+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda3d251635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA3D230000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8A7B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA3DF08000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA3DD04000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA3DA0A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA3D7F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA3D5D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA3D230000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA3E111000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda3d251635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:06:47.420+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:07:47.552+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] MongoDB starting : pid=7676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:07:47.559+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:07:47.610+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:07:47.990+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856867:990651][7676:0x7f9ea3f7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:07:47.990+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:07:48.010+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ea2ead635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9EA2E8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CCA2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9EA3B64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9EA3960000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9EA3666000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9EA3451000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9EA3234000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9EA2E8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9EA3D6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ea2ead635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:07:48.010+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:08:47.150+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=7928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:08:47.158+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:08:47.209+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:08:47.524+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856927:524349][7928:0x7f9d83f7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:08:47.524+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:08:47.535+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d82ead635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D82E8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D83B64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D83960000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D83666000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D83451000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D83234000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D82E8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D83D6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d82ead635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:08:47.535+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:09:47.337+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] MongoDB starting : pid=8137 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:09:47.344+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:09:47.400+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:09:47.740+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507856987:740951][8137:0x7f40be410c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:09:47.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:09:47.753+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40bd340635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40BD31F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B0B3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40BDFF7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40BDDF3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40BDAF9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40BD8E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40BD6C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40BD31F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40BE200000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40bd340635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:09:47.753+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:10:47.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] MongoDB starting : pid=8368 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:10:47.894+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:10:47.944+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:10:48.220+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857048:220853][8368:0x7f490dbd2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:10:48.220+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:10:48.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f490cb02635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F490CAE1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE74FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F490D7B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F490D5B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F490D2BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F490D0A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F490CE89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F490CAE1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F490D9C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f490cb02635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:10:48.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:11:47.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] MongoDB starting : pid=8539 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:11:47.677+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:11:47.727+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:11:48.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857108:19735][8539:0x7f8ebb266c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:11:48.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:11:48.030+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8eba196635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EBA175000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFEE0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EBAE4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EBAC49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EBA94F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EBA73A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EBA51D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EBA175000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EBB056000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8eba196635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:11:48.030+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:12:47.166+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=8792 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:12:47.174+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:12:47.223+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:12:47.536+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857167:536557][8792:0x7f44d86b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:12:47.536+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:12:47.547+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44d75e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44D75BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44D8297000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44D8093000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44D7D99000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44D7B84000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44D7967000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44D75BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44D84A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44d75e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:12:47.547+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:13:47.670+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:13:47.677+0000 I CONTROL [initandlisten] MongoDB starting : pid=9059 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:13:47.678+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:13:47.727+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:13:48.054+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857228:54360][9059:0x7f8468625c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:13:48.054+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:13:48.073+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8467555635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8467534000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F846820C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8468008000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8467D0E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8467AF9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84678DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8467534000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8468415000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8467555635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:13:48.073+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:14:47.559+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] MongoDB starting : pid=9260 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:14:47.566+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:14:47.616+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:14:47.990+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857287:990871][9260:0x7fb7b18bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:14:47.990+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:14:48.011+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb7b07eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB7B07CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43E47000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB7B14A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB7B129E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB7B0FA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB7B0D8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB7B0B72000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB7B07CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB7B16AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb7b07eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:14:48.011+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:15:47.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=9489 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:15:47.158+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:15:47.210+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:15:47.514+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857347:514537][9489:0x7f5951c50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:15:47.514+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:15:47.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5950b80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5950B5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA02CD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5951837000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5951633000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5951339000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5951124000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5950F07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5950B5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5951A40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5950b80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:15:47.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:16:48.008+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=9642 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:16:48.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:16:48.065+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:16:48.332+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857408:331973][9642:0x7fb5d5ddec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:16:48.332+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:16:48.351+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb5d4d0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB5D4CED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF23EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB5D59C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB5D57C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB5D54C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB5D52B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB5D5095000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5D4CED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB5D5BCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb5d4d0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:16:48.351+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:17:47.471+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] MongoDB starting : pid=9893 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:17:47.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:17:47.529+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:17:47.915+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857467:915785][9893:0x7fabf8143c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:17:47.915+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:17:47.935+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fabf7073635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FABF7052000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF720FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FABF7D2A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FABF7B26000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FABF782C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FABF7617000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FABF73FA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FABF7052000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FABF7F33000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fabf7073635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:17:47.935+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:18:47.070+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] MongoDB starting : pid=10161 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:18:47.078+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:18:47.079+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:18:47.129+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:18:47.420+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857527:420335][10161:0x7f9d093fac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:18:47.420+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:18:47.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d0832a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D08309000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC38A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D08FE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D08DDD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D08AE3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D088CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D086B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D08309000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D091EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d0832a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:18:47.439+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:19:47.714+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] MongoDB starting : pid=10364 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:19:47.721+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:19:47.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:19:48.117+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857588:117291][10364:0x7f0d42451c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:19:48.117+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:19:48.127+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d41381635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D41360000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC2DA9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D42038000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D41E34000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D41B3A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D41925000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D41708000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D41360000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D42241000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d41381635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:19:48.127+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:20:47.259+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:20:47.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=10595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:20:47.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:20:47.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:20:47.267+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:20:47.267+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:20:47.267+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:20:47.267+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:20:47.267+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:20:47.267+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:20:47.318+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:20:47.600+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857647:600979][10595:0x7fc86a9e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:20:47.601+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:20:47.611+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc869912635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8698F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC86A5C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC86A3C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC86A0CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC869EB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC869C99000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8698F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC86A7D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc869912635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:20:47.611+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:21:47.982+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] MongoDB starting : pid=10752 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:21:47.989+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:21:48.039+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:21:48.307+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857708:307552][10752:0x7f9c2e978c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:21:48.307+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:21:48.318+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c2d8a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C2D887000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C2E55F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C2E35B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C2E061000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C2DE4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C2DC2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C2D887000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C2E768000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c2d8a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:21:48.318+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:22:47.452+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=11013 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:22:47.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:22:47.510+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:22:47.840+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857767:840781][11013:0x7fc601935c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:22:47.840+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:22:47.851+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc600865635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC600844000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF230EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC60151C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC601318000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC60101E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC600E09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC600BEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC600844000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC601725000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc600865635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:22:47.851+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:23:47.989+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] MongoDB starting : pid=11265 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:23:47.997+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:23:48.046+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:23:48.402+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857828:402142][11265:0x7fbc98c32c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:23:48.402+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:23:48.421+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc97b62635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC97B41000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF57EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC98819000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC98615000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC9831B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC98106000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC97EE9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC97B41000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC98A22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc97b62635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:23:48.421+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:24:47.957+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] MongoDB starting : pid=11467 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:24:47.964+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:24:47.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:24:47.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:24:48.015+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:24:48.337+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857888:337796][11467:0x7fd29d222c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:24:48.337+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:24:48.357+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd29c152635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD29C131000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CDF7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD29CE09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD29CC05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD29C90B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD29C6F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD29C4D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD29C131000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD29D012000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd29c152635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:24:48.357+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:25:47.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] MongoDB starting : pid=11697 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:25:47.499+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:25:47.552+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:25:47.873+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507857947:873635][11697:0x7f52c2093c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:25:47.873+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:25:47.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52c0fc3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52C0FA2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52C1C7A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52C1A76000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52C177C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52C1567000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52C134A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52C0FA2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52C1E83000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52c0fc3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:25:47.884+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:26:47.311+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] MongoDB starting : pid=11849 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:26:47.318+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:26:47.368+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:26:47.744+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858007:744662][11849:0x7fcecddacc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:26:47.744+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:26:47.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcecccdc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCECCCBB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE44FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCECD993000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCECD78F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCECD495000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCECD280000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCECD063000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCECCCBB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCECDB9C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcecccdc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:26:47.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:27:47.900+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] MongoDB starting : pid=12113 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:27:47.907+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:27:47.908+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:27:47.958+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:27:48.251+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858068:251453][12113:0x7f07d3732c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:27:48.251+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:27:48.270+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f07d2662635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F07D2641000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7A6BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F07D3319000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F07D3115000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F07D2E1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F07D2C06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F07D29E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F07D2641000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F07D3522000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f07d2662635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:27:48.270+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:28:47.399+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] MongoDB starting : pid=12375 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:28:47.407+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:28:47.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:28:47.774+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858127:774839][12375:0x7f373334bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:28:47.774+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:28:47.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f373227b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F373225A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D3C9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3732F32000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3732D2E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3732A34000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F373281F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3732602000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F373225A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F373313B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f373227b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:28:47.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:29:47.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] MongoDB starting : pid=12580 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:29:47.121+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:29:47.172+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:29:47.502+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858187:502575][12580:0x7fcede091c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:29:47.502+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:29:47.513+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcedcfc1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCEDCFA0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE22FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCEDDC78000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCEDDA74000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCEDD77A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCEDD565000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCEDD348000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCEDCFA0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCEDDE81000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcedcfc1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:29:47.513+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:30:47.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] MongoDB starting : pid=12810 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:30:47.642+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:30:47.692+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:30:47.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858247:964270][12810:0x7f96548c8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:30:47.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:30:47.974+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96537f8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96537D7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCDCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96544AF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96542AB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9653FB1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9653D9C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9653B7F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96537D7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96546B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96537f8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:30:47.974+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:31:47.370+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] MongoDB starting : pid=12963 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:31:47.378+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:31:47.427+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:31:47.792+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858307:792729][12963:0x7f1abdf5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:31:47.792+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:31:47.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1abce8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1ABCE6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF320FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1ABDB44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1ABD940000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1ABD646000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1ABD431000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1ABD214000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1ABCE6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1ABDD4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1abce8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:31:47.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:32:47.943+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] MongoDB starting : pid=13217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:32:47.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:32:48.002+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:32:48.313+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858368:313450][13217:0x7f1a8c209c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:32:48.313+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:32:48.323+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a8b139635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A8B118000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBBE2A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A8BDF0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A8BBEC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A8B8F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A8B6DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A8B4C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A8B118000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A8BFF9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a8b139635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:32:48.323+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:33:47.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:33:47.457+0000 I CONTROL [initandlisten] MongoDB starting : pid=13473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:33:47.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:33:47.507+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:33:47.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858427:784730][13473:0x7f567b778c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:33:47.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:33:47.797+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f567a6a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F567A687000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F567B35F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F567B15B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F567AE61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F567AC4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F567AA2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F567A687000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F567B568000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f567a6a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:33:47.797+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:34:47.284+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] MongoDB starting : pid=13681 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:34:47.291+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:34:47.342+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:34:47.659+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858487:659217][13681:0x7fe3d7f6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:34:47.659+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:34:47.670+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe3d6e9d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE3D6E7C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE3D7B54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE3D7950000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE3D7656000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE3D7441000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE3D7224000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE3D6E7C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE3D7D5D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe3d6e9d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:34:47.670+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:35:47.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=13911 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:35:47.809+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:35:47.859+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:35:48.104+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858548:104980][13911:0x7f8ab05bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:35:48.105+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:35:48.115+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8aaf4ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8AAF4CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB26FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8AB01A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8AAFFA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8AAFCA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8AAFA92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8AAF875000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8AAF4CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8AB03AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8aaf4ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:35:48.115+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:36:47.489+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] MongoDB starting : pid=14061 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:36:47.496+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:36:47.546+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:36:47.811+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858607:811268][14061:0x7f00a5696c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:36:47.811+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:36:47.821+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f00a45c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F00A45A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB6B6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F00A527D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F00A5079000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F00A4D7F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F00A4B6A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F00A494D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F00A45A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F00A5486000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f00a45c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:36:47.821+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:37:47.951+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:37:47.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=14313 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:37:47.959+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:37:48.008+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:37:48.307+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858668:307654][14313:0x7fc8f38acc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:37:48.307+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:37:48.327+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8f27dc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8F27BB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF59AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8F3493000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8F328F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8F2F95000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8F2D80000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8F2B63000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8F27BB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8F369C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8f27dc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:37:48.327+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:38:47.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] MongoDB starting : pid=14876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:38:47.469+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:38:47.524+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:38:47.912+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858727:912339][14876:0x7f33824c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:38:47.912+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:38:47.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33813f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33813D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD56FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33820AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3381EAA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3381BB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F338199B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F338177E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33813D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33822B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33813f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:38:47.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:39:47.675+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] MongoDB starting : pid=15034 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:39:47.682+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:39:47.732+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:39:47.993+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858787:993837][15034:0x7f27735a4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:39:47.993+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:39:48.004+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27724d4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F27724B3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F277318B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2772F87000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2772C8D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2772A78000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F277285B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F27724B3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2773394000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27724d4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:39:48.004+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:40:47.122+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:40:47.129+0000 I CONTROL [initandlisten] MongoDB starting : pid=15263 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:40:47.129+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:40:47.129+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:40:47.129+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:40:47.129+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:40:47.129+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:40:47.130+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:40:47.130+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:40:47.130+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:40:47.181+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:40:47.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858847:533877][15263:0x7ff9f1ef8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:40:47.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:40:47.546+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9f0e28635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9F0E07000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54667000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF9F1ADF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9F18DB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9F15E1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9F13CC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF9F11AF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9F0E07000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9F1CE8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9f0e28635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:40:47.546+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:41:47.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=15513 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:41:48.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:41:48.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:41:48.354+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858908:354323][15513:0x7f5e3eae6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:41:48.354+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:41:48.364+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e3da16635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E3D9F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E3E6CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E3E4C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E3E1CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E3DFBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E3DD9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E3D9F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E3E8D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e3da16635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:41:48.364+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:42:47.495+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] MongoDB starting : pid=15630 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:42:47.503+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:42:47.554+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:42:47.831+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507858967:830992][15630:0x7f97e72c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:42:47.831+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:42:47.841+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f97e61f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F97E61D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF778FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F97E6EAD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F97E6CA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F97E69AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F97E679A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F97E657D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F97E61D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F97E70B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f97e61f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:42:47.841+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:43:47.971+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] MongoDB starting : pid=15945 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:43:47.978+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:43:48.027+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:43:48.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859028:315196][15945:0x7fe0407d0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:43:48.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:43:48.325+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe03f700635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE03F6DF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E2F8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0403B7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0401B3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE03FEB9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE03FCA4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE03FA87000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE03F6DF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0405C0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe03f700635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:43:48.325+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:44:47.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] MongoDB starting : pid=16151 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:44:48.003+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:44:48.055+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:44:48.375+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859088:375355][16151:0x7f2353512c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:44:48.375+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:44:48.394+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2352442635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2352421000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB69C2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F23530F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2352EF5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2352BFB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F23529E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F23527C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2352421000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2353302000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2352442635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:44:48.394+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:45:47.518+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=16381 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:45:47.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:45:47.576+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:45:47.889+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859147:889666][16381:0x7fdb112ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:45:47.889+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:45:47.910+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb1022f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB1020E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF358FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB10EE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB10CE2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB109E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB107D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB105B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB1020E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB110EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb1022f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:45:47.910+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:46:47.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:46:47.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=16611 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:46:47.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:46:47.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:46:47.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:46:47.347+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:46:47.347+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:46:47.347+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:46:47.347+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:46:47.347+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:46:47.397+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:46:47.747+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859207:747870][16611:0x7fb31459dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:46:47.747+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:46:47.758+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb3134cd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB3134AC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB314184000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB313F80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB313C86000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB313A71000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB313854000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB3134AC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB31438D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb3134cd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:46:47.758+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:47:47.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=16732 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:47:47.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:47:47.940+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:47:48.224+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859268:224667][16732:0x7fbb0b16ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:47:48.224+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:47:48.235+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbb0a09a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBB0A079000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DE63000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBB0AD51000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBB0AB4D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBB0A853000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBB0A63E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBB0A421000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBB0A079000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBB0AF5A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbb0a09a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:47:48.235+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:48:47.362+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] MongoDB starting : pid=17039 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:48:47.370+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:48:47.420+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:48:47.744+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859327:744472][17039:0x7feab48d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:48:47.744+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:48:47.763+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feab3802635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEAB37E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF410FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEAB44B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEAB42B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEAB3FBB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEAB3DA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEAB3B89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEAB37E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEAB46C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feab3802635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:48:47.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:49:47.637+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:49:47.644+0000 I CONTROL [initandlisten] MongoDB starting : pid=17247 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:49:47.644+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:49:47.644+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:49:47.644+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:49:47.644+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:49:47.644+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:49:47.645+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:49:47.645+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:49:47.645+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:49:47.694+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:49:48.019+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859388:19323][17247:0x7f38eaf06c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:49:48.019+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:49:48.039+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f38e9e36635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38E9E15000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F38EAAED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38EA8E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F38EA5EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F38EA3DA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38EA1BD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38E9E15000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38EACF6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f38e9e36635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:49:48.039+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:50:47.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=17469 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:50:47.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:50:47.230+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:50:47.623+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859447:623745][17469:0x7f2b7a78dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:50:47.623+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:50:47.644+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b796bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B7969C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41AB3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B7A374000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B7A170000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B79E76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B79C61000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B79A44000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B7969C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B7A57D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b796bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:50:47.644+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:51:47.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:51:47.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=17712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:51:47.095+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:51:47.146+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:51:47.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859507:533094][17712:0x7fe0346adc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:51:47.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:51:47.553+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0335dd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0335BC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5831000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE034294000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE034090000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE033D96000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE033B81000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE033964000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0335BC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE03449D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0335dd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:51:47.553+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:52:47.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] MongoDB starting : pid=17832 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:52:47.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:52:47.744+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:52:48.057+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859568:57300][17832:0x7f1e1b477c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:52:48.057+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:52:48.068+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e1a3a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E1A386000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CACF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E1B05E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E1AE5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E1AB60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E1A94B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E1A72E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E1A386000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E1B267000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e1a3a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:52:48.069+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:53:47.200+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] MongoDB starting : pid=18127 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:53:47.207+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:53:47.257+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:53:47.639+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859627:639149][18127:0x7fb78972ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:53:47.639+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:53:47.659+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb78865a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB788639000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A6DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB789311000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB78910D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB788E13000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB788BFE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB7889E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB788639000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB78951A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb78865a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:53:47.659+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:54:47.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] MongoDB starting : pid=18337 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:54:47.811+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:54:47.875+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:54:48.182+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859688:182495][18337:0x7fad8a656c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:54:48.182+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:54:48.202+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fad89586635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAD89565000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAD8A23D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAD8A039000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAD89D3F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAD89B2A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAD8990D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAD89565000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAD8A446000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fad89586635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:54:48.202+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:55:47.215+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] MongoDB starting : pid=18559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:55:47.222+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:55:47.274+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:55:47.602+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859747:602543][18559:0x7fb84d93ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:55:47.602+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:55:47.621+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb84c86e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB84C84D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8188E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB84D525000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB84D321000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB84D027000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB84CE12000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB84CBF5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB84C84D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB84D72E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb84c86e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:55:47.621+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:56:47.095+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] MongoDB starting : pid=18799 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:56:47.103+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:56:47.153+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:56:47.446+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859807:446354][18799:0x7f4ecb042c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:56:47.446+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:56:47.459+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ec9f72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4EC9F51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EC9E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4ECAC29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4ECAA25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4ECA72B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4ECA516000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4ECA2F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4EC9F51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4ECAE32000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ec9f72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:56:47.459+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:57:47.590+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:57:47.598+0000 I CONTROL [initandlisten] MongoDB starting : pid=18921 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:57:47.598+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:57:47.598+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:57:47.598+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:57:47.598+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:57:47.599+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:57:47.599+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:57:47.599+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:57:47.599+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:57:47.661+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:57:47.974+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859867:974805][18921:0x7fd5e26d9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:57:47.974+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:57:47.985+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5e1609635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5E15E8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB5C35000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD5E22C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5E20BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5E1DC2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5E1BAD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5E1990000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5E15E8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5E24C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5e1609635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:57:47.985+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:58:47.106+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] MongoDB starting : pid=19231 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:58:47.113+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:58:47.164+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:58:47.505+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859927:505979][19231:0x7fb391a6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:58:47.506+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:58:47.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb39099d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB39097C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF858FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB391654000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB391450000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB391156000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB390F41000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB390D24000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB39097C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB39185D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb39099d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:58:47.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T01:59:47.658+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] MongoDB starting : pid=19441 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] modules: none 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] build environment: 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T01:59:47.666+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T01:59:47.717+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T01:59:48.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507859988:129977][19441:0x7f34dae45c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T01:59:48.130+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T01:59:48.149+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f34d9d75635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F34D9D54000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B0FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F34DAA2C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34DA828000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34DA52E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F34DA319000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F34DA0FC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34D9D54000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34DAC35000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f34d9d75635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T01:59:48.149+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:00:47.311+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] MongoDB starting : pid=19676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:00:47.319+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:00:47.368+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:00:47.650+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860047:650250][19676:0x7f74d1496c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:00:47.650+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:00:47.660+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74d03c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74D03A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF81CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74D107D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74D0E79000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74D0B7F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F74D096A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F74D074D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74D03A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74D1286000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74d03c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:00:47.660+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:01:48.047+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=19915 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:01:48.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:01:48.104+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:01:48.362+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860108:362058][19915:0x7f7a2ec4bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:01:48.362+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:01:48.373+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a2db7b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A2DB5A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9AF6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A2E832000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A2E62E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A2E334000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A2E11F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A2DF02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A2DB5A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A2EA3B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a2db7b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:01:48.373+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:02:47.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] MongoDB starting : pid=20048 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:02:47.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:02:47.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:02:48.230+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860168:230809][20048:0x7f15a0dd8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:02:48.230+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:02:48.246+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f159fd08635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F159FCE7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF685EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15A09BF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15A07BB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15A04C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15A02AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15A008F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F159FCE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15A0BC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f159fd08635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:02:48.246+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:03:47.367+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=20341 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:03:47.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:03:47.425+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:03:47.815+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860227:815916][20341:0x7f3fe8d7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:03:47.816+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:03:47.836+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3fe7cab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3FE7C8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9EA6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3FE8962000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3FE875E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3FE8464000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3FE824F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3FE8032000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3FE7C8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3FE8B6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3fe7cab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:03:47.836+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:04:47.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] MongoDB starting : pid=20552 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:04:47.971+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:04:48.021+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:04:48.357+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860288:357820][20552:0x7f880ee25c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:04:48.357+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:04:48.369+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f880dd55635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F880DD34000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F880EA0C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F880E808000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F880E50E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F880E2F9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F880E0DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F880DD34000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F880EC15000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f880dd55635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:04:48.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:05:47.818+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] MongoDB starting : pid=20770 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:05:47.826+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:05:47.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:05:48.225+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860348:225359][20770:0x7fbbd2b3dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:05:48.225+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:05:48.235+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbbd1a6d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBBD1A4C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD679000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBBD2724000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBBD2520000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBBD2226000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBBD2011000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBBD1DF4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBBD1A4C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBBD292D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbbd1a6d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:05:48.235+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:06:47.696+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] MongoDB starting : pid=21035 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:06:47.704+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:06:47.753+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:06:48.065+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860408:65710][21035:0x7fae44cc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:06:48.065+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:06:48.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fae43bf3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAE43BD2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAE448AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAE446A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAE443AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAE44197000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAE43F7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAE43BD2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAE44AB3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fae43bf3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:06:48.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:07:47.213+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] MongoDB starting : pid=21164 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:07:47.220+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:07:47.221+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:07:47.271+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:07:47.523+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860467:523874][21164:0x7faaf2839c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:07:47.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:07:47.534+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faaf1769635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAAF1748000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAAF2420000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAAF221C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAAF1F22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAAF1D0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAAF1AF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAAF1748000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAAF2629000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faaf1769635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:07:47.534+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:08:47.664+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] MongoDB starting : pid=21464 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:08:47.672+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:08:47.723+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:08:47.998+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860527:998726][21464:0x7fd806a42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:08:47.998+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:08:48.009+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd805972635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD805951000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF114AB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD806629000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD806425000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD80612B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD805F16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD805CF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD805951000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD806832000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd805972635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:08:48.009+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:09:47.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] MongoDB starting : pid=21672 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:09:47.147+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:09:47.198+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:09:47.560+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860587:560477][21672:0x7f3d51c3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:09:47.560+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:09:47.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d50b6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D50B49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3EC7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D51821000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D5161D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D51323000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D5110E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D50EF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D50B49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D51A2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d50b6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:09:47.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:10:47.129+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] MongoDB starting : pid=21896 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:10:47.136+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:10:47.186+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:10:47.550+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860647:550766][21896:0x7f5d253a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:10:47.550+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:10:47.569+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d242d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D242B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D24F8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D24D8A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D24A90000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D2487B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D2465E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D242B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D25197000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d242d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:10:47.569+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:11:47.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:11:48.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=22121 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:11:48.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:11:48.051+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:11:48.373+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860708:373845][22121:0x7f411df7ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:11:48.373+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:11:48.393+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f411ceaa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F411CE89000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F411DB61000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F411D95D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F411D663000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F411D44E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F411D231000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F411CE89000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F411DD6A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f411ceaa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:11:48.393+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:12:47.514+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=22338 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:12:47.522+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:12:47.571+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:12:47.860+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860767:860375][22338:0x7fbbb3b59c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:12:47.860+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:12:47.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbbb2a89635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBBB2A68000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92829000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBBB3740000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBBB353C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBBB3242000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBBB302D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBBB2E10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBBB2A68000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBBB3949000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbbb2a89635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:12:47.871+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:13:48.002+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] MongoDB starting : pid=22659 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:13:48.009+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:13:48.059+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:13:48.350+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860828:350067][22659:0x7f513c41dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:13:48.350+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:13:48.361+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f513b34d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F513B32C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF956FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F513C004000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F513BE00000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F513BB06000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F513B8F1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F513B6D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F513B32C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F513C20D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f513b34d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:13:48.361+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:14:47.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:14:47.493+0000 I CONTROL [initandlisten] MongoDB starting : pid=22819 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:14:47.493+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:14:47.493+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:14:47.493+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:14:47.493+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:14:47.493+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:14:47.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:14:47.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:14:47.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:14:47.543+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:14:47.839+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860887:839964][22819:0x7f5acb539c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:14:47.840+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:14:47.851+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5aca469635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5ACA448000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD71A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5ACB120000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5ACAF1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5ACAC22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5ACAA0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5ACA7F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5ACA448000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5ACB329000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5aca469635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:14:47.851+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:15:47.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] MongoDB starting : pid=23025 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:15:47.349+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:15:47.400+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:15:47.719+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507860947:719477][23025:0x7f09310a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:15:47.719+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:15:47.731+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f092ffd1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F092FFB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D82B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0930C88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0930A84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F093078A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0930575000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0930358000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F092FFB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0930E91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f092ffd1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:15:47.731+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:16:47.153+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] MongoDB starting : pid=23242 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:16:47.163+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:16:47.219+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:16:47.492+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861007:492351][23242:0x7faa6c83ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:16:47.492+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:16:47.502+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa6b76a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA6B749000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9A48A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA6C421000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA6C21D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA6BF23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA6BD0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA6BAF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA6B749000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA6C62A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa6b76a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:16:47.502+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:17:47.640+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] MongoDB starting : pid=23473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:17:47.648+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:17:47.698+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:17:48.046+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861068:46653][23473:0x7f7e97112c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:17:48.046+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:17:48.057+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e96042635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E96021000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B0F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E96CF9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E96AF5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E967FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E965E6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E963C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E96021000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E96F02000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e96042635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:17:48.057+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:18:47.178+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] MongoDB starting : pid=23631 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:18:47.185+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:18:47.238+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:18:47.523+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861127:523787][23631:0x7f6f41d22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:18:47.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:18:47.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f40c52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F40C31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD40FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F41909000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F41705000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F4140B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F411F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F40FD9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F40C31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F41B12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f40c52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:18:47.543+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:19:47.680+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] MongoDB starting : pid=23904 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:19:47.688+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:19:47.738+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:19:48.065+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861188:65350][23904:0x7faa765a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:19:48.065+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:19:48.075+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa754d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA754B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D0AA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA76190000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA75F8C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA75C92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA75A7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA75860000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA754B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA76399000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa754d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:19:48.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:20:47.534+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] MongoDB starting : pid=24125 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:20:47.541+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:20:47.591+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:20:47.873+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861247:873950][24125:0x7f4f21242c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:20:47.874+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:20:47.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4f20172635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4F20151000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF33EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4F20E29000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4F20C25000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4F2092B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4F20716000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4F204F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4F20151000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4F21032000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4f20172635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:20:47.884+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:21:47.355+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] MongoDB starting : pid=24342 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:21:47.363+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:21:47.413+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:21:47.814+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861307:814780][24342:0x7f0443c14c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:21:47.814+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:21:47.834+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0442b44635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0442B23000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04437FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04435F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F04432FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F04430E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0442ECB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0442B23000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0443A04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0442b44635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:21:47.834+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:22:47.972+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] MongoDB starting : pid=24571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:22:47.980+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:22:48.030+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:22:48.419+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861368:419184][24571:0x7f7a5f4fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:22:48.419+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:22:48.438+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a5e42e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A5E40D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC98FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A5F0E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A5EEE1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A5EBE7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A5E9D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A5E7B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A5E40D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A5F2EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a5e42e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:22:48.438+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:23:47.561+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] MongoDB starting : pid=24725 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:23:47.569+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:23:47.619+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:23:47.889+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861427:889500][24725:0x7fd593014c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:23:47.889+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:23:47.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd591f44635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD591F23000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D095000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD592BFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5929F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5926FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5924E8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5922CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD591F23000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD592E04000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd591f44635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:23:47.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:24:48.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] MongoDB starting : pid=25001 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:24:48.041+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:24:48.091+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:24:48.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861488:429443][25001:0x7f3128afbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:24:48.429+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:24:48.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3127a2b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3127A0A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25C1E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F31286E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F31284DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F31281E4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3127FCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3127DB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3127A0A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F31288EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3127a2b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:24:48.440+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:25:47.121+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] MongoDB starting : pid=25228 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:25:47.129+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:25:47.182+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:25:47.486+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861547:486199][25228:0x7f84e1488c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:25:47.486+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:25:47.507+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f84e03b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F84E0397000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF0A5A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84E106F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84E0E6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84E0B71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F84E095C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84E073F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F84E0397000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F84E1278000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f84e03b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:25:47.507+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:26:47.918+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] MongoDB starting : pid=25460 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:26:47.925+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:26:47.975+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:26:48.255+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861608:255795][25460:0x7fc77a9b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:26:48.255+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:26:48.266+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7798e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7798C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24C73000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC77A59C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC77A398000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC77A09E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC779E89000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC779C6C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7798C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC77A7A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7798e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:26:48.266+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:27:47.399+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:27:47.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=25696 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:27:47.406+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:27:47.406+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:27:47.406+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:27:47.406+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:27:47.407+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:27:47.407+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:27:47.407+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:27:47.407+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:27:47.457+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:27:47.771+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861667:771455][25696:0x7f2ee4a90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:27:47.771+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:27:47.784+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ee39c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2EE399F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3180F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2EE4677000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2EE4473000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2EE4179000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2EE3F64000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2EE3D47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2EE399F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2EE4880000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ee39c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:27:47.784+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:28:47.923+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] MongoDB starting : pid=25847 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:28:47.931+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:28:47.981+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:28:48.367+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861728:367470][25847:0x7f1891b9ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:28:48.367+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:28:48.386+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1890ace635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1890AAD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1891785000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1891581000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1891287000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1891072000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1890E55000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1890AAD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F189198E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1890ace635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:28:48.387+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:29:47.518+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=26126 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:29:47.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:29:47.574+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:29:47.944+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861787:944510][26126:0x7f0dfc07fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:29:47.944+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:29:47.964+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0dfafaf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0DFAF8E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0DFBC66000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0DFBA62000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0DFB768000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0DFB553000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0DFB336000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0DFAF8E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0DFBE6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0dfafaf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:29:47.964+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:30:47.434+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:30:47.442+0000 I CONTROL [initandlisten] MongoDB starting : pid=26348 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:30:47.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:30:47.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:30:47.824+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861847:824694][26348:0x7f0193611c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:30:47.824+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:30:47.835+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0192541635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0192520000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01931F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0192FF4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0192CFA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0192AE5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01928C8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0192520000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0193401000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0192541635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:30:47.835+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:31:47.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] MongoDB starting : pid=26559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:31:47.306+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:31:47.357+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:31:47.635+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861907:635068][26559:0x7f1e908e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:31:47.635+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:31:47.645+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e8f817635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E8F7F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E904CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E902CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E8FFD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E8FDBB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E8FB9E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E8F7F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E906D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e8f817635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:31:47.645+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:32:47.783+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] MongoDB starting : pid=26789 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:32:47.791+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:32:47.842+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:32:48.140+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507861968:140388][26789:0x7f39a3efac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:32:48.140+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:32:48.161+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39a2e2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F39A2E09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39A3AE1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39A38DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39A35E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39A33CE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39A31B1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F39A2E09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F39A3CEA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39a2e2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:32:48.161+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:33:47.282+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] MongoDB starting : pid=26931 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:33:47.289+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:33:47.338+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:33:47.656+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862027:656424][26931:0x7f83997b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:33:47.656+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:33:47.667+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83986e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83986C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83993A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F839919C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8398EA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8398C8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8398A70000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83986C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83995A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83986e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:33:47.667+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:34:47.794+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] MongoDB starting : pid=27218 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:34:47.801+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:34:47.851+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:34:48.160+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862088:160218][27218:0x7f19c25d5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:34:48.160+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:34:48.170+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19c1505635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19C14E4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE483000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19C21BC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19C1FB8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19C1CBE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19C1AA9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19C188C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19C14E4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19C23C5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19c1505635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:34:48.170+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:35:47.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:35:47.674+0000 I CONTROL [initandlisten] MongoDB starting : pid=27449 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:35:47.674+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:35:47.674+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:35:47.675+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:35:47.675+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:35:47.675+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:35:47.675+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:35:47.675+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:35:47.675+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:35:47.724+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:35:48.084+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862148:84092][27449:0x7f54aecffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:35:48.084+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:35:48.103+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54adc2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54ADC0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54AE8E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54AE6E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F54AE3E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54AE1D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54ADFB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54ADC0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54AEAEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54adc2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:35:48.103+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:36:47.523+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:36:47.530+0000 I CONTROL [initandlisten] MongoDB starting : pid=27674 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:36:47.531+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:36:47.580+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:36:47.898+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862207:898541][27674:0x7f0ec7892c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:36:47.898+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:36:47.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ec67c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EC67A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01224000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EC7479000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EC7275000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EC6F7B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EC6D66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EC6B49000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EC67A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EC7682000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ec67c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:36:47.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:37:48.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] MongoDB starting : pid=27902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:37:48.051+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:37:48.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:37:48.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862268:440814][27902:0x7f9e7402bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:37:48.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:37:48.452+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e72f5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E72F3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E73C12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E73A0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E73714000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E734FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E732E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E72F3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E73E1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e72f5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:37:48.452+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:38:47.578+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] MongoDB starting : pid=28040 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:38:47.586+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:38:47.637+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:38:47.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862327:910440][28040:0x7f7f53786c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:38:47.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:38:47.921+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f526b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F52695000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4A90000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F5336D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F53169000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F52E6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F52C5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F52A3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F52695000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F53576000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f526b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:38:47.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:39:48.067+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] MongoDB starting : pid=28340 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:39:48.075+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:39:48.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:39:48.427+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862388:427771][28340:0x7f93b7da4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:39:48.427+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:39:48.448+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93b6cd4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93B6CB3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF45AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93B798B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93B7787000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93B748D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93B7278000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93B705B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93B6CB3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93B7B94000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93b6cd4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:39:48.448+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:40:48.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=28563 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:40:48.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:40:48.857+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:40:49.259+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862449:259622][28563:0x7f9b09a8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:40:49.259+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:40:49.280+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b089bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B0899C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B09674000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B09470000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B09176000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B08F61000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B08D44000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B0899C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B0987D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b089bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:40:49.280+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:41:48.747+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] MongoDB starting : pid=28787 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:41:48.755+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:41:48.805+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:41:49.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862509:173453][28787:0x7f4797492c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:41:49.173+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:41:49.196+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f47963c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47963A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF96E38000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4797079000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4796E75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4796B7B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4796966000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4796749000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47963A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4797282000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f47963c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:41:49.196+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:42:48.322+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] MongoDB starting : pid=29027 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:42:48.329+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:42:48.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:42:48.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:42:48.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:42:48.652+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862568:652865][29027:0x7fbe5da47c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:42:48.652+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:42:48.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbe5c977635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBE5C956000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DE6F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBE5D62E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBE5D42A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBE5D130000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBE5CF1B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBE5CCFE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBE5C956000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBE5D837000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbe5c977635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:42:48.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:43:48.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=29183 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:43:48.798+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:43:48.850+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:43:49.204+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862629:204874][29183:0x7fa93e9eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:43:49.204+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:43:49.224+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa93d91a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA93D8F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA93E5D1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA93E3CD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA93E0D3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA93DEBE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA93DCA1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA93D8F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA93E7DA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa93d91a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:43:49.225+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:44:48.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] MongoDB starting : pid=29478 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:44:48.357+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:44:48.407+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:44:48.722+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862688:722943][29478:0x7f85153f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:44:48.723+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:44:48.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8514326635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8514305000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD30FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8514FDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8514DD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8514ADF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F85148CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F85146AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8514305000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F85151E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8514326635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:44:48.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:45:48.999+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] MongoDB starting : pid=29699 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:45:49.007+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:45:49.057+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:45:49.333+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862749:333255][29699:0x7fe1cde5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:45:49.333+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:45:49.344+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1ccd8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1CCD6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF734FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1CDA44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1CD840000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1CD546000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1CD331000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1CD114000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1CCD6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1CDC4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1ccd8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:45:49.344+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:46:48.803+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] MongoDB starting : pid=29913 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:46:48.811+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:46:48.862+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:46:49.150+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862809:150463][29913:0x7f9879f1fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:46:49.150+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:46:49.160+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9878e4f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9878E2E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF600FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9879B06000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9879902000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9879608000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98793F3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98791D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9878E2E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9879D0F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9878e4f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:46:49.161+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:47:48.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] MongoDB starting : pid=30139 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:47:48.298+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:47:48.348+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:47:48.713+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862868:713263][30139:0x7f0995090c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:47:48.713+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:47:48.732+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0993fc0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0993F9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF612FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0994C77000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0994A73000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0994779000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0994564000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0994347000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0993F9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0994E80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0993fc0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:47:48.732+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:48:48.854+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] MongoDB starting : pid=30272 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:48:48.861+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:48:48.862+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:48:48.911+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:48:49.272+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862929:272566][30272:0x7f62ff177c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:48:49.272+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:48:49.286+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62fe0a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62FE086000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1EC0A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62FED5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62FEB5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62FE860000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62FE64B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62FE42E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62FE086000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62FEF67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62fe0a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:48:49.286+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:49:48.418+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] MongoDB starting : pid=30550 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:49:48.425+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:49:48.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:49:48.844+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507862988:844154][30550:0x7f0cb389bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:49:48.844+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:49:48.863+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0cb27cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CB27AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF52D87000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CB3482000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CB327E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CB2F84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CB2D6F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CB2B52000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CB27AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CB368B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0cb27cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:49:48.863+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:50:48.472+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] MongoDB starting : pid=30681 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:50:48.479+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:50:48.480+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:50:48.529+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:50:48.879+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863048:879749][30681:0x7fcab030dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:50:48.879+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:50:48.899+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcaaf23d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCAAF21C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66822000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCAAFEF4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCAAFCF0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCAAF9F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCAAF7E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCAAF5C4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCAAF21C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCAB00FD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcaaf23d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:50:48.899+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:51:48.353+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] MongoDB starting : pid=30899 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:51:48.361+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:51:48.412+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:51:48.780+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863108:780943][30899:0x7f409ccfbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:51:48.781+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:51:48.800+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f409bc2b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F409BC0A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62C5C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F409C8E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F409C6DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F409C3E4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F409C1CF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F409BFB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F409BC0A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F409CAEB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f409bc2b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:51:48.800+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:52:48.935+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] MongoDB starting : pid=31135 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:52:48.946+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:52:49.002+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:52:49.339+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863169:339884][31135:0x7fafff409c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:52:49.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:52:49.359+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faffe339635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAFFE318000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51C42000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAFFEFF0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAFFEDEC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAFFEAF2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAFFE8DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAFFE6C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAFFE318000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAFFF1F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faffe339635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:52:49.359+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:53:48.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] MongoDB starting : pid=31349 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:53:48.486+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:53:48.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:53:48.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863228:805441][31349:0x7f936baaac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:53:48.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:53:48.815+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f936a9da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F936A9B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F936B691000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F936B48D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F936B193000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F936AF7E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F936AD61000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F936A9B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F936B89A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f936a9da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:53:48.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:54:48.943+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] MongoDB starting : pid=31501 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:54:48.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:54:49.000+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:54:49.365+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863289:365942][31501:0x7f47f329cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:54:49.366+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:54:49.385+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f47f21cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47F21AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F47F2E83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F47F2C7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F47F2985000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F47F2770000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47F2553000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47F21AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47F308C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f47f21cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:54:49.385+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:55:48.664+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] MongoDB starting : pid=31765 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:55:48.672+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:55:48.725+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:55:48.990+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863348:990390][31765:0x7f4b58ce1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:55:48.990+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:55:49.000+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b57c11635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B57BF0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B588C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B586C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B583CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B581B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B57F98000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B57BF0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B58AD1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b57c11635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:55:49.000+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:56:48.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] MongoDB starting : pid=31994 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:56:48.442+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:56:48.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:56:48.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863408:841844][31994:0x7fc4e16bbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:56:48.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:56:48.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4e05eb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4E05CA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4E12A2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4E109E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4E0DA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4E0B8F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4E0972000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4E05CA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4E14AB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4e05eb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:56:48.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:57:48.975+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] MongoDB starting : pid=32219 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:57:48.983+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:57:49.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:57:49.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863469:318252][32219:0x7f79481cbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:57:49.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:57:49.328+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f79470fb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F79470DA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF158FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7947DB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7947BAE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79478B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F794769F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7947482000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F79470DA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7947FBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f79470fb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:57:49.328+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:58:48.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] MongoDB starting : pid=32445 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:58:48.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:58:48.507+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:58:48.791+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863528:791141][32445:0x7f6e57665c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:58:48.791+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:58:48.801+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6e56595635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6E56574000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6E5724C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6E57048000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6E56D4E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6E56B39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6E5691C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6E56574000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6E57455000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6e56595635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:58:48.801+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T02:59:48.925+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T02:59:48.932+0000 I CONTROL [initandlisten] MongoDB starting : pid=32603 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T02:59:48.932+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T02:59:48.932+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T02:59:48.932+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T02:59:48.932+0000 I CONTROL [initandlisten] modules: none 2017-10-13T02:59:48.932+0000 I CONTROL [initandlisten] build environment: 2017-10-13T02:59:48.933+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T02:59:48.933+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T02:59:48.933+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T02:59:48.982+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T02:59:49.273+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863589:273596][32603:0x7f6588982c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T02:59:49.273+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T02:59:49.288+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65878b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6587891000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF22AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6588569000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6588365000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F658806B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6587E56000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6587C39000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6587891000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6588772000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65878b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T02:59:49.288+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:00:48.203+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:00:48.210+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:00:48.261+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:00:48.652+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863648:651987][388:0x7fd3bdd88c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:00:48.652+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:00:48.671+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3bccb8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3BCC97000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF584FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3BD96F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3BD76B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3BD471000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3BD25C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD3BD03F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3BCC97000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3BDB78000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3bccb8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:00:48.671+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:01:48.078+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] MongoDB starting : pid=624 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:01:48.087+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:01:48.137+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:01:48.425+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863708:425195][624:0x7fb80b45bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:01:48.425+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:01:48.435+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb80a38b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB80A36A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF50BE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB80B042000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB80AE3E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB80AB44000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB80A92F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB80A712000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB80A36A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB80B24B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb80a38b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:01:48.435+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:02:48.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:02:48.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:02:48.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:02:48.757+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863768:757946][859:0x7f28d5c90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:02:48.758+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:02:48.768+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f28d4bc0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F28D4B9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF540FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F28D5877000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F28D5673000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F28D5379000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F28D5164000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F28D4F47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F28D4B9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F28D5A80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f28d4bc0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:02:48.768+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:03:48.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] MongoDB starting : pid=1077 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:03:48.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:03:48.945+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:03:49.300+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863829:300190][1077:0x7fbe7893ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:03:49.300+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:03:49.310+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbe7786a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBE77849000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBE78521000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBE7831D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBE78023000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBE77E0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBE77BF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBE77849000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBE7872A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbe7786a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:03:49.310+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:04:48.433+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] MongoDB starting : pid=1226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:04:48.440+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:04:48.491+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:04:48.778+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863888:778412][1226:0x7f53f2e07c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:04:48.778+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:04:48.792+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53f1d37635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53F1D16000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53F29EE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53F27EA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53F24F0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F53F22DB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F53F20BE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53F1D16000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53F2BF7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53f1d37635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:04:48.792+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:05:48.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] MongoDB starting : pid=1487 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:05:48.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:05:48.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:05:49.133+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507863949:133842][1487:0x7febd1fbac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:05:49.133+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:05:49.153+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7febd0eea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEBD0EC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF3EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEBD1BA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEBD199D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEBD16A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEBD148E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEBD1271000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEBD0EC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEBD1DAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7febd0eea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:05:49.153+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:06:48.618+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] MongoDB starting : pid=1725 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:06:48.627+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:06:48.679+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:06:49.034+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864009:34797][1725:0x7f3ba0cd2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:06:49.034+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:06:49.054+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b9fc02635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B9FBE1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01A32000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BA08B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BA06B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BA03BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BA01A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B9FF89000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B9FBE1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BA0AC2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b9fc02635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:06:49.054+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:07:48.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] MongoDB starting : pid=1953 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:07:48.177+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:07:48.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:07:48.513+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864068:513739][1953:0x7fac7972fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:07:48.513+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:07:48.524+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac7865f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC7863E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF98FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC79316000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC79112000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC78E18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC78C03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC789E6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC7863E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC7951F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac7865f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:07:48.524+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:08:48.658+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] MongoDB starting : pid=2176 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:08:48.666+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:08:48.716+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:08:49.027+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864129:27233][2176:0x7f7e4e07bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:08:49.027+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:08:49.046+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7e4cfab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7E4CF8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4471000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7E4DC62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7E4DA5E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7E4D764000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7E4D54F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7E4D332000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7E4CF8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7E4DE6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7e4cfab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:08:49.046+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:09:48.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:09:48.174+0000 I CONTROL [initandlisten] MongoDB starting : pid=2328 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:09:48.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:09:48.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:09:48.541+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864188:541914][2328:0x7fef150d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:09:48.542+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:09:48.553+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef14006635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF13FE5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF644FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF14CBD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF14AB9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF147BF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF145AA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF1438D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF13FE5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF14EC6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef14006635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:09:48.553+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:10:48.086+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=2582 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:10:48.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:10:48.150+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:10:48.488+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864248:488305][2582:0x7f27fdbe5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:10:48.488+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:10:48.499+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27fcb15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F27FCAF4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8D81000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27FD7CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27FD5C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F27FD2CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F27FD0B9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F27FCE9C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F27FCAF4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27FD9D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27fcb15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:10:48.499+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:11:48.907+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] MongoDB starting : pid=2834 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:11:48.915+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:11:48.965+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:11:49.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864309:287233][2834:0x7f5cef864c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:11:49.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:11:49.299+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5cee794635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5CEE773000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAA25F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5CEF44B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5CEF247000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5CEEF4D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5CEED38000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5CEEB1B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5CEE773000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5CEF654000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5cee794635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:11:49.299+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:12:48.426+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=3073 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:12:48.434+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:12:48.484+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:12:48.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864368:837294][3073:0x7fd5b17d9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:12:48.837+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:12:48.856+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd5b0709635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD5B06E8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD5B13C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD5B11BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD5B0EC2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD5B0CAD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD5B0A90000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD5B06E8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD5B15C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd5b0709635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:12:48.856+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:13:48.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] MongoDB starting : pid=3299 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:13:48.995+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:13:49.048+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:13:49.378+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864429:378803][3299:0x7f74abe9bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:13:49.378+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:13:49.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f74aadcb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F74AADAA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74ABA82000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74AB87E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F74AB584000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F74AB36F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F74AB152000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F74AADAA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74ABC8B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f74aadcb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:13:49.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:14:48.521+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] MongoDB starting : pid=3461 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:14:48.530+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:14:48.580+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:14:48.859+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864488:859929][3461:0x7f563bb25c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:14:48.859+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:14:48.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f563aa55635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F563AA34000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F563B70C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F563B508000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F563B20E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F563AFF9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F563ADDC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F563AA34000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F563B915000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f563aa55635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:14:48.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:15:48.289+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] MongoDB starting : pid=3719 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:15:48.298+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:15:48.349+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:15:48.632+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864548:632231][3719:0x7f13433c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:15:48.632+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:15:48.643+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f13422f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F13422D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1342FAC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1342DA8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1342AAE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1342899000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F134267C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F13422D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F13431B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f13422f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:15:48.643+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:16:49.010+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] MongoDB starting : pid=3959 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:16:49.018+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:16:49.072+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:16:49.437+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864609:437240][3959:0x7f4a181dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:16:49.437+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:16:49.457+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4a1710f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4A170EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF998FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4A17DC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4A17BC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4A178C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4A176B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4A17496000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4A170EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4A17FCF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4a1710f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:16:49.457+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:17:48.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=4195 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:17:48.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:17:48.640+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:17:48.972+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864668:972888][4195:0x7f85cfe31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:17:48.972+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:17:48.983+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f85ced61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F85CED40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DC19000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F85CFA18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F85CF814000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F85CF51A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F85CF305000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F85CF0E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F85CED40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F85CFC21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f85ced61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:17:48.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:18:48.113+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] MongoDB starting : pid=4406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:18:48.121+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:18:48.170+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:18:48.500+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864728:500624][4406:0x7f305319fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:18:48.500+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:18:48.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30520cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F30520AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74835000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3052D86000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3052B82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3052888000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3052673000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3052456000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F30520AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3052F8F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30520cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:18:48.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:19:48.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] MongoDB starting : pid=4565 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:19:48.642+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:19:48.692+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:19:49.053+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864789:53809][4565:0x7fe944b06c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:19:49.053+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:19:49.073+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe943a36635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE943A15000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0327C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE9446ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE9444E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE9441EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE943FDA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE943DBD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE943A15000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE9448F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe943a36635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:19:49.073+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:20:48.517+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] MongoDB starting : pid=4836 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:20:48.524+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:20:48.578+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:20:48.875+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864848:875381][4836:0x7fcf2de31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:20:48.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:20:48.885+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcf2cd61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCF2CD40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF654FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCF2DA18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCF2D814000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCF2D51A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCF2D305000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCF2D0E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCF2CD40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCF2DC21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcf2cd61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:20:48.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:21:48.254+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] MongoDB starting : pid=5276 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:21:48.261+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:21:48.311+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:21:48.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864908:670796][5276:0x7f804a5dac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:21:48.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:21:48.690+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f804950a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80494E9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8C84C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F804A1C1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8049FBD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8049CC3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8049AAE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8049891000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80494E9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F804A3CA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f804950a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:21:48.691+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:22:48.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] MongoDB starting : pid=5635 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:22:48.833+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:22:48.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:22:49.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507864969:153041][5635:0x7f4b26292c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:22:49.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:22:49.163+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b251c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B251A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F2A4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B25E79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B25C75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B2597B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B25766000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B25549000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B251A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B26082000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b251c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:22:49.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:23:48.310+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:23:48.317+0000 I CONTROL [initandlisten] MongoDB starting : pid=5985 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:23:48.317+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:23:48.318+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:23:48.367+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:23:48.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865028:662883][5985:0x7fb7e7ff1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:23:48.663+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:23:48.682+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb7e6f21635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB7E6F00000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40659000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB7E7BD8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB7E79D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB7E76DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB7E74C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB7E72A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB7E6F00000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB7E7DE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb7e6f21635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:23:48.682+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:24:48.823+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=6257 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:24:48.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:24:48.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:24:49.231+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865089:231495][6257:0x7f23fe924c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:24:49.231+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:24:49.244+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f23fd854635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F23FD833000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B673000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F23FE50B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F23FE307000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F23FE00D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F23FDDF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F23FDBDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F23FD833000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F23FE714000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f23fd854635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:24:49.244+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:25:48.397+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] MongoDB starting : pid=6516 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:25:48.404+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:25:48.459+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:25:48.728+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865148:728831][6516:0x7fc1022e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:25:48.728+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:25:48.739+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc101216635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1011F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF038FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC101ECD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC101CC9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC1019CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1017BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC10159D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1011F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1020D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc101216635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:25:48.739+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:26:48.667+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] MongoDB starting : pid=6750 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:26:48.675+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:26:48.725+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:26:49.137+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865209:137303][6750:0x7fe9c787fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:26:49.137+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:26:49.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe9c67af635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE9C678E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF280FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE9C7466000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE9C7262000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE9C6F68000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE9C6D53000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE9C6B36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE9C678E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE9C766F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe9c67af635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:26:49.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:27:48.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] MongoDB starting : pid=6989 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:27:48.292+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:27:48.347+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:27:48.609+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865268:609349][6989:0x7f37e5cb6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:27:48.609+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:27:48.619+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37e4be6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37E4BC5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD3EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37E589D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37E5699000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F37E539F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37E518A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F37E4F6D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37E4BC5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F37E5AA6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37e4be6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:27:48.619+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:28:48.743+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] MongoDB starting : pid=7217 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:28:48.750+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:28:48.800+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:28:49.167+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865329:167764][7217:0x7fe9f61b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:28:49.167+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:28:49.187+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe9f50e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE9F50BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF22C0F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE9F5D97000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE9F5B93000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE9F5899000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE9F5684000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE9F5467000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE9F50BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE9F5FA0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe9f50e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:28:49.188+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:29:48.310+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] MongoDB starting : pid=7468 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:29:48.317+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:29:48.367+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:29:48.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865388:643442][7468:0x7f8e70e22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:29:48.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:29:48.653+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e6fd52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E6FD31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF73AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E70A09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E70805000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E7050B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E702F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E700D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E6FD31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E70C12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e6fd52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:29:48.653+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:30:48.775+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] MongoDB starting : pid=7593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:30:48.782+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:30:48.783+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:30:48.833+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:30:49.129+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865449:129308][7593:0x7f448da2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:30:49.129+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:30:49.139+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f448c95e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F448C93D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F448D615000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F448D411000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F448D117000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F448CF02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F448CCE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F448C93D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F448D81E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f448c95e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:30:49.139+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:31:48.162+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:31:48.169+0000 I CONTROL [initandlisten] MongoDB starting : pid=7877 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:31:48.170+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:31:48.220+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:31:48.562+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865508:562369][7877:0x7f90df5e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:31:48.562+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:31:48.583+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f90de512635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90DE4F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C0E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90DF1C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90DEFC5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90DECCB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90DEAB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F90DE899000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90DE4F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90DF3D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f90de512635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:31:48.583+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:32:48.707+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] MongoDB starting : pid=8126 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:32:48.715+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:32:48.766+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:32:49.025+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865569:25844][8126:0x7f82a6e79c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:32:49.025+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:32:49.045+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f82a5da9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F82A5D88000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F82A6A60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F82A685C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F82A6562000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F82A634D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F82A6130000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F82A5D88000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F82A6C69000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f82a5da9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:32:49.046+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:33:48.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] MongoDB starting : pid=8331 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:33:48.177+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:33:48.227+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:33:48.519+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865628:519043][8331:0x7f5c53e28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:33:48.519+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:33:48.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c52d58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C52D37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C53A0F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C5380B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C53511000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C532FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C530DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C52D37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C53C18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c52d58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:33:48.530+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:34:48.664+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] MongoDB starting : pid=8597 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:34:48.672+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:34:48.722+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:34:49.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865689:52078][8597:0x7f2a6bc7fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:34:49.052+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:34:49.062+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2a6abaf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2A6AB8E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2A6B866000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2A6B662000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2A6B368000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2A6B153000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2A6AF36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2A6AB8E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2A6BA6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2a6abaf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:34:49.062+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:35:48.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] MongoDB starting : pid=8720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:35:48.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:35:48.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:35:48.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865748:608040][8720:0x7fd37977bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:35:48.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:35:48.627+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd3786ab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD37868A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF870FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD379362000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD37915E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD378E64000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD378C4F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD378A32000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD37868A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD37956B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd3786ab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:35:48.627+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:36:48.374+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] MongoDB starting : pid=9000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:36:48.384+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:36:48.437+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:36:48.763+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865808:763672][9000:0x7f07bcca3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:36:48.763+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:36:48.782+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f07bbbd3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F07BBBB2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF20A81000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F07BC88A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F07BC686000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F07BC38C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F07BC177000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F07BBF5A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F07BBBB2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F07BCA93000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f07bbbd3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:36:48.782+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:37:48.906+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=9245 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:37:48.913+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:37:48.963+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:37:49.294+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865869:294430][9245:0x7f279a088c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:37:49.294+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:37:49.316+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2798fb8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2798F97000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F641000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2799C6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2799A6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2799771000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F279955C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F279933F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2798F97000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2799E78000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2798fb8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:37:49.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:38:48.442+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] MongoDB starting : pid=9451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:38:48.450+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:38:48.500+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:38:48.746+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865928:746769][9451:0x7f51d2c26c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:38:48.746+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:38:48.757+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51d1b56635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51D1B35000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FB46000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51D280D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51D2609000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51D230F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51D20FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51D1EDD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51D1B35000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51D2A16000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51d1b56635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:38:48.757+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:39:48.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:39:48.897+0000 I CONTROL [initandlisten] MongoDB starting : pid=9701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:39:48.897+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:39:48.897+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:39:48.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:39:48.898+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:39:48.898+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:39:48.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:39:48.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:39:48.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:39:48.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:39:49.352+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507865989:352367][9701:0x7fca80680c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:39:49.352+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:39:49.371+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca7f5b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA7F58F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60ABC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA80267000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA80063000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA7FD69000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA7FB54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA7F937000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA7F58F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA80470000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca7f5b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:39:49.371+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:40:48.491+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=9828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:40:48.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:40:48.548+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:40:48.886+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866048:886081][9828:0x7fdb454fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:40:48.886+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:40:48.896+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb4442d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB4440C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF028CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB450E4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB44EE0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB44BE6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB449D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB447B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB4440C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB452ED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb4442d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:40:48.896+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:41:48.337+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=10113 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:41:48.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:41:48.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:41:48.764+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866108:764543][10113:0x7f7dd9feec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:41:48.764+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:41:48.784+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dd8f1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DD8EFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB72FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DD9BD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DD99D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DD96D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DD94C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DD92A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DD8EFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DD9DDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dd8f1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:41:48.784+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:42:48.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=10359 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:42:48.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:42:48.972+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:42:49.288+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866169:288109][10359:0x7f8e2f226c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:42:49.288+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:42:49.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e2e156635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E2E135000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF40FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E2EE0D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E2EC09000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E2E90F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E2E6FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E2E4DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E2E135000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E2F016000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e2e156635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:42:49.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:43:48.438+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] MongoDB starting : pid=10589 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:43:48.447+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:43:48.500+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:43:48.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866228:841341][10589:0x7f08d577ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:43:48.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:43:48.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f08d46aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F08D4689000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB6DB3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F08D5361000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F08D515D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F08D4E63000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F08D4C4E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F08D4A31000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F08D4689000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F08D556A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f08d46aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:43:48.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:44:48.978+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] MongoDB starting : pid=10834 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:44:48.986+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:44:49.037+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:44:49.412+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866289:412479][10834:0x7f40188b7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:44:49.412+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:44:49.423+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40177e7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40177C6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F401849E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F401829A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4017FA0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4017D8B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4017B6E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40177C6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40186A7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40177e7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:44:49.423+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:45:48.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] MongoDB starting : pid=10949 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:45:48.558+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:45:48.610+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:45:48.900+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866348:900907][10949:0x7fbc5ef95c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:45:48.900+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:45:48.911+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc5dec5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC5DEA4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFC6B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC5EB7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC5E978000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC5E67E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC5E469000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC5E24C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC5DEA4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC5ED85000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc5dec5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:45:48.911+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:46:48.503+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] MongoDB starting : pid=11230 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:46:48.510+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:46:48.562+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:46:48.868+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866408:868441][11230:0x7fa059172c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:46:48.868+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:46:48.879+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa0580a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA058081000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF315D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA058D59000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA058B55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA05885B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA058646000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA058429000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA058081000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA058F62000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa0580a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:46:48.879+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:47:49.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] MongoDB starting : pid=11466 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:47:49.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:47:49.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:47:49.339+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866469:338996][11466:0x7f9a112c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:47:49.339+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:47:49.350+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a101f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A101D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC018000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A10EA8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A10CA4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A109AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A10795000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A10578000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A101D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A110B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a101f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:47:49.350+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:48:48.478+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] MongoDB starting : pid=11674 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:48:48.486+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:48:48.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:48:48.807+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866528:807902][11674:0x7ff2f01fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:48:48.807+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:48:48.818+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff2ef12e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF2EF10D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF2EFDE5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF2EFBE1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2EF8E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF2EF6D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF2EF4B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF2EF10D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF2EFFEE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff2ef12e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:48:48.818+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:49:48.965+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] MongoDB starting : pid=11918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:49:48.973+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:49:49.022+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:49:49.304+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866589:304536][11918:0x7f78954e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:49:49.304+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:49:49.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7894419635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F78943F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9C29000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78950D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7894ECC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7894BD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78949BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78947A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F78943F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F78952D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7894419635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:49:49.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:50:48.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] MongoDB starting : pid=12036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:50:48.459+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:50:48.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:50:48.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866648:828903][12036:0x7f38246d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:50:48.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:50:48.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3823602635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38235E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49657000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F38242B9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38240B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3823DBB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3823BA6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3823989000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38235E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38244C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3823602635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:50:48.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:51:48.830+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:51:48.837+0000 I CONTROL [initandlisten] MongoDB starting : pid=12316 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:51:48.837+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:51:48.838+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:51:48.889+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:51:49.134+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866709:134637][12316:0x7f9596539c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:51:49.134+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:51:49.145+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9595469635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9595448000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF789B7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9596120000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9595F1C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9595C22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9595A0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F95957F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9595448000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9596329000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9595469635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:51:49.145+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:52:48.270+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] MongoDB starting : pid=12560 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:52:48.277+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:52:48.328+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:52:48.677+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866768:677669][12560:0x7f0cf54fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:52:48.677+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:52:48.688+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0cf442e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CF440D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF622FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CF50E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CF4EE1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CF4BE7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CF49D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CF47B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CF440D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CF52EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0cf442e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:52:48.688+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:53:48.803+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] MongoDB starting : pid=12768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:53:48.811+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:53:48.863+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:53:49.239+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866829:239333][12768:0x7f0420572c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:53:49.239+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:53:49.258+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f041f4a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F041F481000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE84FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0420159000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F041FF55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F041FC5B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F041FA46000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F041F829000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F041F481000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0420362000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f041f4a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:53:49.258+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:54:48.388+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] MongoDB starting : pid=13016 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:54:48.396+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:54:48.447+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:54:48.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866888:783517][13016:0x7f066660cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:54:48.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:54:48.803+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f066553c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F066551B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F06661F3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0665FEF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0665CF5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0665AE0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F06658C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F066551B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F06663FC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f066553c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:54:48.803+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:55:48.926+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] MongoDB starting : pid=13130 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:55:48.933+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:55:48.983+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:55:49.311+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507866949:311937][13130:0x7f5010223c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:55:49.312+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:55:49.322+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f500f153635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F500F132000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEFEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F500FE0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F500FC06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F500F90C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F500F6F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F500F4DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F500F132000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5010013000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f500f153635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:55:49.322+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:56:48.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=13416 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:56:48.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:56:48.298+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:56:48.665+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867008:665444][13416:0x7f5558182c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:56:48.665+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:56:48.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55570b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5557091000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5BED0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5557D69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5557B65000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F555786B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5557656000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5557439000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5557091000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5557F72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55570b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:56:48.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:57:48.807+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=13655 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:57:48.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:57:48.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:57:49.151+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867069:151913][13655:0x7fb841a24c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:57:49.151+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:57:49.162+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb840954635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB840933000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF652FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB84160B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB841407000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB84110D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB840EF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB840CDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB840933000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB841814000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb840954635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:57:49.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:58:48.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] MongoDB starting : pid=13868 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:58:48.307+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:58:48.357+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:58:48.652+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867128:652877][13868:0x7f676cccdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:58:48.652+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:58:48.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f676bbfd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F676BBDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4DFF0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F676C8B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F676C6B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F676C3B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F676C1A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F676BF84000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F676BBDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F676CABD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f676bbfd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:58:48.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T03:59:48.797+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] MongoDB starting : pid=14126 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] modules: none 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] build environment: 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T03:59:48.805+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T03:59:48.854+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T03:59:49.145+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867189:145183][14126:0x7fd0f4669c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T03:59:49.145+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T03:59:49.164+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0f3599635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0F3578000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD0F4250000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0F404C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0F3D52000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0F3B3D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0F3920000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0F3578000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0F4459000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0f3599635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T03:59:49.164+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:00:48.291+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:00:48.298+0000 I CONTROL [initandlisten] MongoDB starting : pid=14234 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:00:48.299+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:00:48.350+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:00:48.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867248:707471][14234:0x7f31cd132c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:00:48.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:00:48.727+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f31cc062635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F31CC041000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F31CCD19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F31CCB15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F31CC81B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F31CC606000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F31CC3E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F31CC041000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F31CCF22000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f31cc062635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:00:48.727+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:01:48.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=14394 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:01:48.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:01:48.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:01:48.830+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867308:830437][14394:0x7effd4370c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:01:48.830+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:01:48.840+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7effd32a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFD327F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9F476000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFD3F57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFD3D53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFD3A59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFD3844000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFD3627000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFD327F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFD4160000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7effd32a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:01:48.841+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:02:48.279+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] MongoDB starting : pid=15083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:02:48.287+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:02:48.339+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:02:48.624+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867368:624076][15083:0x7f87569b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:02:48.624+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:02:48.634+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f87558e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F87558C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF156BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F875659F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F875639B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F87560A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8755E8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8755C6F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87558C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87567A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f87558e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:02:48.634+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:03:48.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:03:48.773+0000 I CONTROL [initandlisten] MongoDB starting : pid=15291 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:03:48.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:03:48.823+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:03:49.126+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867429:126186][15291:0x7f364058fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:03:49.126+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:03:49.137+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f363f4bf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F363F49E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE02FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3640176000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F363FF72000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F363FC78000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F363FA63000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F363F846000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F363F49E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F364037F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f363f4bf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:03:49.137+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:04:48.282+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] MongoDB starting : pid=15545 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:04:48.289+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:04:48.290+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:04:48.339+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:04:48.627+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867488:627974][15545:0x7f1377302c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:04:48.628+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:04:48.640+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1376232635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1376211000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08E07000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1376EE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1376CE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F13769EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F13767D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F13765B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1376211000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F13770F2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1376232635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:04:48.640+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:05:48.759+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] MongoDB starting : pid=15747 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:05:48.767+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:05:48.817+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:05:49.139+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867549:139028][15747:0x7f127df18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:05:49.139+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:05:49.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f127ce48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F127CE27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF09CEB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F127DAFF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F127D8FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F127D601000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F127D3EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F127D1CF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F127CE27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F127DD08000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f127ce48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:05:49.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:06:48.831+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] MongoDB starting : pid=15896 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:06:48.839+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:06:48.893+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:06:49.201+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867609:201415][15896:0x7f0f51d62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:06:49.201+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:06:49.220+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0f50c92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0F50C71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE74A0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0F51949000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0F51745000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0F5144B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0F51236000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0F51019000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0F50C71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0F51B52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0f50c92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:06:49.220+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:07:48.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] MongoDB starting : pid=16196 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:07:48.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:07:48.409+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:07:48.701+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867668:701589][16196:0x7f66ff839c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:07:48.701+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:07:48.712+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f66fe769635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F66FE748000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F66FF420000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F66FF21C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F66FEF22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F66FED0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F66FEAF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F66FE748000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F66FF629000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f66fe769635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:07:48.712+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:08:48.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=16414 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:08:48.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:08:48.901+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:08:49.196+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867729:196038][16414:0x7f7905af4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:08:49.196+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:08:49.206+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7904a24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7904A03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79056DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79054D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79051DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7904FC8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7904DAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7904A03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79058E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7904a24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:08:49.206+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:09:48.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] MongoDB starting : pid=16670 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:09:48.345+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:09:48.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:09:48.666+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867788:666390][16670:0x7f51f3f98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:09:48.666+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:09:48.676+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51f2ec8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51F2EA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF476FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51F3B7F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51F397B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51F3681000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51F346C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51F324F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51F2EA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51F3D88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51f2ec8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:09:48.676+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:10:48.806+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=16885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:10:48.814+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:10:48.863+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:10:49.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867849:153398][16885:0x7f041a156c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:10:49.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:10:49.163+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0419086635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0419065000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D479000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0419D3D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0419B39000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F041983F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F041962A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F041940D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0419065000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0419F46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0419086635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:10:49.164+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:11:48.373+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] MongoDB starting : pid=17035 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:11:48.381+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:11:48.432+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:11:48.785+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867908:785070][17035:0x7f53884c9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:11:48.785+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:11:48.796+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53873f9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53873D8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF584E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53880B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5387EAC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5387BB2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F538799D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5387780000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53873D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53882B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53873f9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:11:48.796+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:12:48.919+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] MongoDB starting : pid=17408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:12:48.926+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:12:48.977+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:12:49.321+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507867969:321983][17408:0x7f52e78e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:12:49.322+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:12:49.332+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52e6816635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52E67F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD78FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52E74CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52E72C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52E6FCF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52E6DBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52E6B9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52E67F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52E76D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52e6816635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:12:49.332+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:13:48.464+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] MongoDB starting : pid=17622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:13:48.471+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:13:48.472+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:13:48.524+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:13:48.845+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868028:845677][17622:0x7f0e0f2c1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:13:48.845+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:13:48.856+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0e0e1f1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0E0E1D0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEF93000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0E0EEA8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0E0ECA4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0E0E9AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0E0E795000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0E0E578000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0E0E1D0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0E0F0B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0e0e1f1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:13:48.856+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:14:48.997+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] MongoDB starting : pid=17877 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:14:49.007+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:14:49.057+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:14:49.391+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868089:391033][17877:0x7f336705ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:14:49.391+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:14:49.405+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3365f8a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3365F69000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3366C41000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3366A3D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3366743000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F336652E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3366311000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3365F69000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3366E4A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3365f8a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:14:49.405+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:15:48.542+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:15:48.549+0000 I CONTROL [initandlisten] MongoDB starting : pid=18087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:15:48.550+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:15:48.599+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:15:48.895+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868148:895249][18087:0x7f4c55c2bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:15:48.895+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:15:48.906+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4c54b5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4C54B3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF746FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4C55812000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4C5560E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4C55314000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4C550FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4C54EE2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4C54B3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4C55A1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4c54b5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:15:48.906+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:16:48.569+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] MongoDB starting : pid=18235 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:16:48.576+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:16:48.626+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:16:48.978+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868208:978311][18235:0x7fe4ad2a2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:16:48.978+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:16:48.988+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4ac1d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4AC1B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4ACE89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4ACC85000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4AC98B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4AC776000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4AC559000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4AC1B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4AD092000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4ac1d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:16:48.988+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:17:48.115+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=18561 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:17:48.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:17:48.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:17:48.509+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868268:509252][18561:0x7f25c0f7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:17:48.509+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:17:48.528+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25bfeab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F25BFE8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBEEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F25C0B62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F25C095E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F25C0664000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F25C044F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F25C0232000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F25BFE8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F25C0D6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25bfeab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:17:48.528+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:18:48.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] MongoDB starting : pid=18788 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:18:48.664+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:18:48.715+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:18:49.013+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868329:13027][18788:0x7fbe6f04cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:18:49.013+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:18:49.024+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbe6df7c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBE6DF5B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBE6EC33000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBE6EA2F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBE6E735000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBE6E520000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBE6E303000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBE6DF5B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBE6EE3C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbe6df7c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:18:49.024+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:19:48.157+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] MongoDB starting : pid=19046 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:19:48.165+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:19:48.216+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:19:48.531+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868388:531634][19046:0x7effe2147c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:19:48.531+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:19:48.543+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7effe1077635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFE1056000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE61D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFE1D2E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFE1B2A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFE1830000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFE161B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFE13FE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFE1056000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFE1F37000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7effe1077635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:19:48.543+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:20:48.658+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] MongoDB starting : pid=19261 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:20:48.666+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:20:48.715+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:20:48.997+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868448:997633][19261:0x7f4718832c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:20:48.997+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:20:49.017+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4717762635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4717741000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF585C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4718419000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4718215000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4717F1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4717D06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4717AE9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4717741000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4718622000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4717762635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:20:49.017+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:21:48.892+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=19411 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:21:48.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:21:48.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:21:49.280+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868509:280555][19411:0x7fde0cc09c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:21:49.280+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:21:49.293+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde0bb39635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE0BB18000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA08FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE0C7F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE0C5EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE0C2F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE0C0DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE0BEC0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE0BB18000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE0C9F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde0bb39635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:21:49.293+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:22:48.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] MongoDB starting : pid=19717 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:22:48.431+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:22:48.482+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:22:48.847+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868568:847421][19717:0x7f4ccac20c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:22:48.847+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:22:48.868+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4cc9b50635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4CC9B2F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA44FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4CCA807000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4CCA603000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4CCA309000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4CCA0F4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4CC9ED7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4CC9B2F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4CCAA10000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4cc9b50635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:22:48.868+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:23:48.989+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] MongoDB starting : pid=19937 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:23:48.997+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:23:49.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:23:49.414+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868629:414207][19937:0x7ff386d13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:23:49.414+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:23:49.424+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff385c43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF385C22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A2B9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3868FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3866F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3863FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3861E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF385FCA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF385C22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF386B03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff385c43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:23:49.424+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:24:48.560+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] MongoDB starting : pid=20191 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:24:48.568+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:24:48.618+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:24:48.910+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868688:910286][20191:0x7fa403d38c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:24:48.910+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:24:48.920+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa402c68635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA402C47000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA40391F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA40371B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA403421000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA40320C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA402FEF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA402C47000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA403B28000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa402c68635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:24:48.921+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:25:48.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=20407 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:25:48.065+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:25:48.114+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:25:48.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868748:416821][20407:0x7f8f837ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:25:48.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:25:48.427+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f8272f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F8270E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5EF0A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F833E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F831E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F82EE8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F82CD3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F82AB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F8270E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F835EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f8272f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:25:48.427+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:26:48.595+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=20563 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:26:48.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:26:48.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:26:48.970+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868808:970654][20563:0x7f9f8c992c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:26:48.970+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:26:48.981+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9f8b8c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9F8B8A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41E83000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9F8C579000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9F8C375000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9F8C07B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9F8BE66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9F8BC49000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9F8B8A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9F8C782000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9f8b8c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:26:48.981+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:27:48.110+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] MongoDB starting : pid=20853 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:27:48.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:27:48.167+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:27:48.504+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868868:504391][20853:0x7ff8f5a58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:27:48.504+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:27:48.524+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8f4988635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF8F4967000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54FC5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8F563F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8F543B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8F5141000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF8F4F2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF8F4D0F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF8F4967000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF8F5848000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8f4988635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:27:48.524+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:28:48.648+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] MongoDB starting : pid=21116 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:28:48.655+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:28:48.705+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:28:49.032+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868929:32364][21116:0x7f4854a23c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:28:49.032+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:28:49.044+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4853953635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4853932000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16FD0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F485460A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4854406000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F485410C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4853EF7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4853CDA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4853932000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4854813000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4853953635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:28:49.044+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:29:48.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] MongoDB starting : pid=21361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:29:48.178+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:29:48.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:29:48.590+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507868988:590569][21361:0x7f13f68cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:29:48.590+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:29:48.601+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f13f57fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F13F57DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA28FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F13F64B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F13F62B1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F13F5FB7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F13F5DA2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F13F5B85000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F13F57DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F13F66BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f13f57fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:29:48.601+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:30:48.724+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] MongoDB starting : pid=21581 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:30:48.733+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:30:48.784+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:30:49.073+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869049:73263][21581:0x7fb5a9534c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:30:49.073+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:30:49.083+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb5a8464635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB5A8443000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB5A911B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB5A8F17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB5A8C1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB5A8A08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB5A87EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5A8443000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB5A9324000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb5a8464635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:30:49.083+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:31:48.778+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=21722 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:31:48.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:31:48.835+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:31:49.097+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869109:97833][21722:0x7fa8ee492c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:31:49.097+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:31:49.108+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8ed3c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8ED3A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE82B7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8EE079000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8EDE75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8EDB7B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8ED966000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8ED749000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8ED3A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8EE282000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8ed3c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:31:49.108+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:32:48.237+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] MongoDB starting : pid=21996 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:32:48.244+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:32:48.306+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:32:48.571+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869168:571107][21996:0x7f8126ce2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:32:48.571+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:32:48.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8125c12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8125BF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF292FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F81268C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F81266C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F81263CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81261B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8125F99000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8125BF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8126AD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8125c12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:32:48.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:33:48.704+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] MongoDB starting : pid=22236 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:33:48.712+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:33:48.776+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:33:49.123+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869229:123093][22236:0x7fd876773c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:33:49.123+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:33:49.133+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8756a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD875682000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99BDB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD87635A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD876156000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD875E5C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD875C47000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD875A2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD875682000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD876563000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8756a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:33:49.134+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:34:48.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=22479 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:34:48.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:34:48.316+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:34:48.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869288:674844][22479:0x7fb586d8cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:34:48.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:34:48.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb585cbc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB585C9B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF35064000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB586973000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB58676F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB586475000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB586260000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB586043000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB585C9B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB586B7C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb585cbc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:34:48.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:35:48.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] MongoDB starting : pid=22618 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:35:48.823+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:35:48.875+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:35:49.244+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869349:244853][22618:0x7f198bf75c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:35:49.244+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:35:49.264+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f198aea5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F198AE84000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF984FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F198BB5C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F198B958000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F198B65E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F198B449000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F198B22C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F198AE84000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F198BD65000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f198aea5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:35:49.264+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:36:48.231+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] MongoDB starting : pid=22846 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:36:48.239+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:36:48.289+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:36:48.664+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869408:664316][22846:0x7fc785128c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:36:48.664+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:36:48.683+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc784058635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC784037000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53226000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC784D0F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC784B0B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC784811000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7845FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7843DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC784037000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC784F18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc784058635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:36:48.683+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:37:48.819+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=22987 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:37:48.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:37:48.879+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:37:49.225+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869469:225286][22987:0x7f9c362b7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:37:49.225+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:37:49.245+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c351e7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C351C6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF54ECD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C35E9E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C35C9A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C359A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C3578B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C3556E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C351C6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C360A7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c351e7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:37:49.245+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:38:48.365+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] MongoDB starting : pid=23282 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:38:48.373+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:38:48.425+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:38:48.754+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869528:754174][23282:0x7f565aa6ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:38:48.754+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:38:48.764+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f565999a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5659979000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D3E7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F565A651000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F565A44D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F565A153000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5659F3E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5659D21000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5659979000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F565A85A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f565999a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:38:48.764+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:39:48.896+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=23526 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:39:48.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:39:48.960+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:39:49.319+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869589:319183][23526:0x7f6ef5fa5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:39:49.319+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:39:49.329+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6ef4ed5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6EF4EB4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF532FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6EF5B8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6EF5988000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6EF568E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6EF5479000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6EF525C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6EF4EB4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6EF5D95000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6ef4ed5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:39:49.330+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:40:48.459+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] MongoDB starting : pid=23751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:40:48.467+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:40:48.516+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:40:48.874+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869648:874853][23751:0x7fd3912d8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:40:48.874+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:40:48.885+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd390208635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD3901E7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD390EBF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD390CBB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3909C1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3907AC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD39058F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD3901E7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD3910C8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd390208635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:40:48.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:41:48.523+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] MongoDB starting : pid=23983 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:41:48.531+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:41:48.581+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:41:48.872+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869708:872171][23983:0x7ff331f0fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:41:48.872+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:41:48.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff330e3f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF330E1E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7CB27000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF331AF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3318F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3315F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3313E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3311C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF330E1E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF331CFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff330e3f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:41:48.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:42:49.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] MongoDB starting : pid=24121 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:42:49.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:42:49.061+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:42:49.364+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869769:364831][24121:0x7f27d9b55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:42:49.364+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:42:49.375+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27d8a85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F27D8A64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D4F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27D973C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27D9538000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F27D923E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F27D9029000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F27D8E0C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F27D8A64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27D9945000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27d8a85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:42:49.375+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:43:48.505+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] MongoDB starting : pid=24422 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:43:48.516+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:43:48.517+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:43:48.575+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:43:48.900+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869828:900810][24422:0x7f09fdd56c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:43:48.900+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:43:48.911+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09fcc86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09FCC65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF95C8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09FD93D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09FD739000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09FD43F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09FD22A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09FD00D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09FCC65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09FDB46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09fcc86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:43:48.911+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:44:49.028+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] MongoDB starting : pid=24657 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:44:49.036+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:44:49.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:44:49.089+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:44:49.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869889:429977][24657:0x7f0255105c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:44:49.430+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:44:49.450+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0254035635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0254014000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1A4A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0254CEC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0254AE8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F02547EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F02545D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F02543BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0254014000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0254EF5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0254035635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:44:49.450+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:45:48.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=24875 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:45:48.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:45:48.628+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:45:48.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507869948:894303][24875:0x7fd1caaadc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:45:48.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:45:48.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd1c99dd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD1C99BC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF954FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD1CA694000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD1CA490000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD1CA196000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD1C9F81000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD1C9D64000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD1C99BC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD1CA89D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd1c99dd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:45:48.905+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:46:49.046+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] MongoDB starting : pid=25108 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:46:49.054+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:46:49.103+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:46:49.430+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870009:430427][25108:0x7f7cbad6cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:46:49.430+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:46:49.443+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7cb9c9c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CB9C7B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF834B1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CBA953000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CBA74F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CBA455000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CBA240000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CBA023000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CB9C7B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CBAB5C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7cb9c9c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:46:49.443+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:47:48.564+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] MongoDB starting : pid=25241 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:47:48.572+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:47:48.623+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:47:48.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870068:894677][25241:0x7f1d734cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:47:48.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:47:48.905+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d723fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D723DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFE97000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D730B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D72EB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D72BB7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D729A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D72785000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D723DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D732BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d723fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:47:48.905+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:48:49.043+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] MongoDB starting : pid=25552 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:48:49.051+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:48:49.100+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:48:49.360+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870129:360211][25552:0x7f7d5be6ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:48:49.360+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:48:49.370+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d5ad9a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D5AD79000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D5BA51000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D5B84D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D5B553000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D5B33E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D5B121000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D5AD79000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D5BC5A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d5ad9a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:48:49.370+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:49:48.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] MongoDB starting : pid=25776 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:49:48.493+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:49:48.543+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:49:48.817+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870188:817370][25776:0x7fc6a949bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:49:48.817+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:49:48.829+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6a83cb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6A83AA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD62FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6A9082000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6A8E7E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6A8B84000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6A896F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC6A8752000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6A83AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC6A928B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6a83cb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:49:48.829+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:50:48.959+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] MongoDB starting : pid=25999 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:50:48.966+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:50:49.017+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:50:49.315+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870249:315824][25999:0x7f37f1dbac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:50:49.315+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:50:49.329+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37f0cea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37F0CC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2605F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37F19A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37F179D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F37F14A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37F128E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F37F1071000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37F0CC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F37F1BAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37f0cea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:50:49.329+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:51:48.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=26222 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:51:48.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:51:48.360+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:51:48.740+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870308:739999][26222:0x7f81d6d4fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:51:48.740+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:51:48.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f81d5c7f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F81D5C5E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1487F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F81D6936000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F81D6732000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F81D6438000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81D6223000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F81D6006000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F81D5C5E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F81D6B3F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f81d5c7f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:51:48.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:52:48.877+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] MongoDB starting : pid=26352 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:52:48.884+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:52:48.933+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:52:49.207+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870369:207497][26352:0x7f7ee4f5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:52:49.207+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:52:49.217+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ee3e8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EE3E6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC460000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EE4B46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EE4942000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EE4648000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EE4433000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EE4216000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EE3E6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EE4D4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ee3e8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:52:49.218+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:53:48.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=26642 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:53:48.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:53:48.399+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:53:48.756+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870428:756076][26642:0x7f1783784c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:53:48.756+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:53:48.766+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f17826b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1782693000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5FA06000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F178336B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1783167000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1782E6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1782C58000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1782A3B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1782693000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1783574000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f17826b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:53:48.766+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:54:48.902+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=26863 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:54:48.910+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:54:48.959+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:54:49.232+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870489:232237][26863:0x7f4899aa2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:54:49.232+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:54:49.242+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f48989d2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F48989B1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF649F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4899689000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4899485000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F489918B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4898F76000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4898D59000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F48989B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4899892000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f48989d2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:54:49.242+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:55:48.381+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] MongoDB starting : pid=27090 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:55:48.389+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:55:48.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:55:48.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870548:805341][27090:0x7fece78c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:55:48.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:55:48.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fece67f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECE67D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63EA0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECE74A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECE72A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECE6FAB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECE6D96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECE6B79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECE67D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FECE76B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fece67f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:55:48.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:56:48.251+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] MongoDB starting : pid=27325 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:56:48.260+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:56:48.316+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:56:48.653+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870608:653818][27325:0x7fb1472aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:56:48.653+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:56:48.664+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb1461de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1461BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFADCEA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB146E95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB146C91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB146997000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB146782000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB146565000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1461BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB14709E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb1461de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:56:48.664+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:57:48.786+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] MongoDB starting : pid=27454 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:57:48.796+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:57:48.846+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:57:49.190+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870669:190071][27454:0x7fa297fa9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:57:49.190+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:57:49.203+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa296ed9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA296EB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF56CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA297B90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA29798C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA297692000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA29747D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA297260000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA296EB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA297D99000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa296ed9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:57:49.203+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:58:48.340+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] MongoDB starting : pid=27768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:58:48.352+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:58:48.414+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:58:48.791+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870728:791183][27768:0x7f8cdb4b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:58:48.791+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:58:48.810+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8cda3e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8CDA3C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49CEA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8CDB09A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8CDAE96000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8CDAB9C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8CDA987000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8CDA76A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8CDA3C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8CDB2A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8cda3e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:58:48.810+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T04:59:48.948+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] MongoDB starting : pid=27986 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] modules: none 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] build environment: 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T04:59:48.956+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T04:59:49.006+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T04:59:49.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870789:261352][27986:0x7f1b609e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T04:59:49.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T04:59:49.271+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b5f917635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B5F8F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF75AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B605CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B603CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B600D0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B5FEBB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B5FC9E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B5F8F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B607D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b5f917635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T04:59:49.272+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:00:49.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] MongoDB starting : pid=28235 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:00:49.043+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:00:49.093+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:00:49.366+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870849:366903][28235:0x7fc98af76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:00:49.366+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:00:49.377+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc989ea6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC989E85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39FC1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC98AB5D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC98A959000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC98A65F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC98A44A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC98A22D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC989E85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC98AD66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc989ea6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:00:49.377+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:01:48.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=28463 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:01:48.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:01:48.826+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:01:49.116+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870909:116520][28463:0x7f507967ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:01:49.116+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:01:49.127+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f50785ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F507858D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF926FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5079265000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5079061000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5078D67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5078B52000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5078935000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F507858D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F507946E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f50785ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:01:49.127+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:02:48.453+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] MongoDB starting : pid=28594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:02:48.461+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:02:48.514+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:02:48.850+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507870968:850197][28594:0x7f2603aa8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:02:48.850+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:02:48.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f26029d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F26029B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFC4D9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F260368F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F260348B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2603191000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2602F7C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2602D5F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F26029B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2603898000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f26029d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:02:48.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:03:48.998+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] MongoDB starting : pid=28903 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:03:49.005+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:03:49.055+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:03:49.336+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871029:336846][28903:0x7f75a1f5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:03:49.336+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:03:49.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f75a0e8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F75A0E6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F75A1B42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F75A193E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F75A1644000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F75A142F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F75A1212000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F75A0E6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F75A1D4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f75a0e8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:03:49.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:04:48.484+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] MongoDB starting : pid=29127 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:04:48.491+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:04:48.540+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:04:48.864+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871088:864233][29127:0x7f7846ef1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:04:48.864+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:04:48.875+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7845e21635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7845E00000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF158FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7846AD8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78468D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78465DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78463C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F78461A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7845E00000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7846CE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7845e21635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:04:48.875+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:05:49.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] MongoDB starting : pid=29353 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:05:49.013+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:05:49.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:05:49.408+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871149:408812][29353:0x7f0a2293ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:05:49.408+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:05:49.428+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a2186a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A21849000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A22521000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A2231D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A22023000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A21E0E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A21BF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A21849000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A2272A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a2186a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:05:49.428+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:06:48.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] MongoDB starting : pid=29580 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:06:48.883+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:06:48.933+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:06:49.232+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871209:232335][29580:0x7f7d7a12dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:06:49.232+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:06:49.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d7905d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D7903C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B969000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D79D14000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D79B10000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D79816000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D79601000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D793E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D7903C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D79F1D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d7905d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:06:49.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:07:48.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] MongoDB starting : pid=29693 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:07:48.098+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:07:48.150+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:07:48.476+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871268:476802][29693:0x7f5a86ebdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:07:48.476+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:07:48.488+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a85ded635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A85DCC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14DA2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A86AA4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A868A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A865A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A86391000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A86174000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A85DCC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A86CAD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a85ded635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:07:48.488+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:08:48.606+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=29992 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:08:48.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:08:48.663+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:08:48.982+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871328:982752][29992:0x7f81dbe85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:08:48.982+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:08:49.002+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f81dadb5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F81DAD94000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F81DBA6C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F81DB868000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F81DB56E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F81DB359000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F81DB13C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F81DAD94000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F81DBC75000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f81dadb5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:08:49.002+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:09:48.123+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] MongoDB starting : pid=30174 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:09:48.131+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:09:48.181+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:09:48.488+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871388:488778][30174:0x7f8fb22d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:09:48.488+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:09:48.508+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8fb1202635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8FB11E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8FB1EB9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8FB1CB5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8FB19BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8FB17A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8FB1589000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8FB11E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8FB20C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8fb1202635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:09:48.508+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:10:48.632+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] MongoDB starting : pid=30361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:10:48.641+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:10:48.693+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:10:48.975+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871448:975222][30361:0x7fe924286c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:10:48.975+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:10:48.986+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe9231b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE923195000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD39E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE923E6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE923C69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE92396F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE92375A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE92353D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE923195000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE924076000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe9231b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:10:48.986+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:11:48.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] MongoDB starting : pid=30593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:11:48.476+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:11:48.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:11:48.884+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871508:884675][30593:0x7fe4a806cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:11:48.884+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:11:48.895+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4a6f9c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4A6F7B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4A7C53000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4A7A4F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4A7755000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4A7540000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4A7323000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4A6F7B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4A7E5C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4a6f9c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:11:48.895+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:12:48.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] MongoDB starting : pid=30810 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:12:48.607+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:12:48.658+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:12:48.921+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871568:921160][30810:0x7f84e3eeec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:12:48.921+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:12:48.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f84e2e1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F84E2DFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB5B5B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F84E3AD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F84E38D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F84E35D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F84E33C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F84E31A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F84E2DFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F84E3CDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f84e2e1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:12:48.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:13:48.059+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] MongoDB starting : pid=30982 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:13:48.067+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:13:48.119+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:13:48.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871628:490435][30982:0x7f1026213c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:13:48.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:13:48.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1025143635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1025122000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1025DFA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1025BF6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F10258FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F10256E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F10254CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1025122000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1026003000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1025143635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:13:48.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:14:48.631+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=31252 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:14:48.639+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:14:48.689+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:14:48.961+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871688:961370][31252:0x7f369ab9ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:14:48.961+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:14:48.972+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3699aca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3699AA9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F369A781000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F369A57D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F369A283000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F369A06E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3699E51000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3699AA9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F369A98A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3699aca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:14:48.972+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:15:48.111+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] MongoDB starting : pid=31495 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:15:48.118+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:15:48.119+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:15:48.168+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:15:48.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871748:556848][31495:0x7fb70e5bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:15:48.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:15:48.576+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb70d4ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB70D4C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF623EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB70E1A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB70DF9D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB70DCA3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB70DA8E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB70D871000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB70D4C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB70E3AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb70d4ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:15:48.576+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:16:49.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] MongoDB starting : pid=31728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:16:49.012+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:16:49.062+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:16:49.363+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871809:363062][31728:0x7f913a9b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:16:49.363+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:16:49.375+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91398e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91398C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCBE55000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F913A59F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F913A39B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F913A0A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9139E8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9139C6F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91398C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F913A7A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91398e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:16:49.375+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:17:48.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=31937 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:17:48.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:17:48.820+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:17:49.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871869:209829][31937:0x7f22f3552c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:17:49.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:17:49.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22f2482635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22F2461000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB223E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22F3139000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22F2F35000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22F2C3B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F22F2A26000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F22F2809000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22F2461000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22F3342000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22f2482635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:17:49.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:18:48.359+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:18:48.366+0000 I CONTROL [initandlisten] MongoDB starting : pid=32109 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:18:48.366+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:18:48.366+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:18:48.367+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:18:48.367+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:18:48.367+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:18:48.367+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:18:48.367+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:18:48.367+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:18:48.416+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:18:48.866+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871928:866286][32109:0x7f65da8bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:18:48.866+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:18:48.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65d97ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F65D97CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F65DA4A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F65DA2A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F65D9FA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F65D9D92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F65D9B75000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F65D97CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F65DA6AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65d97ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:18:48.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:19:49.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=32367 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:19:49.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:19:49.065+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:19:49.452+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507871989:452024][32367:0x7f1345c71c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:19:49.452+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:19:49.472+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1344ba1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1344B80000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1345858000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1345654000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F134535A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1345145000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1344F28000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1344B80000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1345A61000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1344ba1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:19:49.472+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:20:48.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] MongoDB starting : pid=32604 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:20:48.610+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:20:48.661+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:20:49.033+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872049:33696][32604:0x7fbaab503c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:20:49.033+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:20:49.053+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbaaa433635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAAA412000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF749DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAAB0EA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAAAEE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAAABEC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAAA9D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAAA7BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAAA412000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAAB2F3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbaaa433635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:20:49.053+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:21:48.441+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] MongoDB starting : pid=347 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:21:48.449+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:21:48.505+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:21:48.785+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872108:785627][347:0x7f80e6bdec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:21:48.785+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:21:48.796+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80e5b0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80E5AED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80E67C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80E65C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80E62C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80E60B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80E5E95000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80E5AED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80E69CE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80e5b0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:21:48.796+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:22:49.054+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] MongoDB starting : pid=570 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:22:49.062+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:22:49.112+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:22:49.452+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872169:452642][570:0x7fac95cb7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:22:49.452+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:22:49.465+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac94be7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC94BC6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDBAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC9589E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC9569A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC953A0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC9518B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC94F6E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC94BC6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC95AA7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac94be7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:22:49.465+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:23:49.592+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] MongoDB starting : pid=733 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:23:49.601+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:23:49.651+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:23:49.974+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872229:974975][733:0x7fe6b92aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:23:49.975+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:23:49.987+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe6b81de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE6B81BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBAEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE6B8E95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE6B8C91000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE6B8997000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE6B8782000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE6B8565000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE6B81BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE6B909E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe6b81de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:23:49.987+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:24:49.106+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] MongoDB starting : pid=996 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:24:49.114+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:24:49.165+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:24:49.474+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872289:474030][996:0x7f58ba50ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:24:49.474+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:24:49.493+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f58b943a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F58B9419000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F58BA0F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F58B9EED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F58B9BF3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F58B99DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F58B97C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F58B9419000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F58BA2FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f58b943a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:24:49.493+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:25:49.630+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] MongoDB starting : pid=1240 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:25:49.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:25:49.688+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:25:50.018+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872350:18042][1240:0x7f9a08c5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:25:50.018+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:25:50.037+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a07b8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A07B6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A08842000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A0863E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A08344000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A0812F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A07F12000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A07B6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A08A4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a07b8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:25:50.037+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:26:49.430+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] MongoDB starting : pid=1460 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:26:49.438+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:26:49.494+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:26:49.853+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872409:853806][1460:0x7fde2ebc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:26:49.853+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:26:49.873+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde2daf3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE2DAD2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF372FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE2E7AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE2E5A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE2E2AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE2E097000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE2DE7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE2DAD2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE2E9B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde2daf3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:26:49.873+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:27:49.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=1682 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:27:49.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:27:49.765+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:27:50.048+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872470:48894][1682:0x7fc320182c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:27:50.048+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:27:50.059+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc31f0b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC31F091000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE10FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC31FD69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC31FB65000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC31F86B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC31F656000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC31F439000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC31F091000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC31FF72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc31f0b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:27:50.059+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:28:49.188+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] MongoDB starting : pid=1857 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:28:49.196+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:28:49.250+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:28:49.648+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872529:648746][1857:0x7fcb3a804c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:28:49.648+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:28:49.668+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcb39734635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCB39713000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB3A3EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB3A1E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCB39EED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCB39CD8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCB39ABB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCB39713000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB3A5F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcb39734635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:28:49.668+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:29:49.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] MongoDB starting : pid=2124 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:29:49.798+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:29:49.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:29:49.853+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:29:50.137+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872590:137804][2124:0x7f4bac46bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:29:50.137+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:29:50.148+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4bab39b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4BAB37A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF485C6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4BAC052000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4BABE4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4BABB54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4BAB93F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4BAB722000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4BAB37A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4BAC25B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4bab39b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:29:50.148+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:30:49.271+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] MongoDB starting : pid=2366 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:30:49.279+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:30:49.328+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:30:49.712+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872649:712974][2366:0x7f29b4bfec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:30:49.713+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:30:49.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f29b3b2e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F29B3B0D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F29B47E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F29B45E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F29B42E7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F29B40D2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F29B3EB5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F29B3B0D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F29B49EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f29b3b2e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:30:49.734+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:31:49.144+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] MongoDB starting : pid=2572 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:31:49.152+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:31:49.203+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:31:49.570+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872709:570729][2572:0x7fc5bf1f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:31:49.570+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:31:49.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc5be129635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC5BE108000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E86C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC5BEDE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC5BEBDC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC5BE8E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC5BE6CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC5BE4B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC5BE108000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC5BEFE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc5be129635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:31:49.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:32:49.235+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] MongoDB starting : pid=2804 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:32:49.243+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:32:49.293+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:32:49.572+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872769:572625][2804:0x7f6799914c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:32:49.572+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:32:49.592+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6798844635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6798823000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA19C6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67994FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67992F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6798FFD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6798DE8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6798BCB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6798823000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6799704000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6798844635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:32:49.592+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:33:49.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=2971 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:33:49.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:33:49.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:33:50.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872830:52565][2971:0x7f47613e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:33:50.052+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:33:50.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4760319635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47602F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4760FD0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4760DCC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4760AD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F47608BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47606A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47602F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47611D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4760319635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:33:50.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:34:49.190+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] MongoDB starting : pid=3237 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:34:49.198+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:34:49.248+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:34:49.523+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872889:523302][3237:0x7fd28176dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:34:49.523+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:34:49.533+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd28069d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD28067C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD281354000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD281150000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD280E56000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD280C41000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD280A24000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD28067C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD28155D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd28069d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:34:49.533+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:35:49.671+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] MongoDB starting : pid=3479 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:35:49.678+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:35:49.679+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:35:49.730+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:35:50.018+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507872950:18744][3479:0x7f4549563c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:35:50.018+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:35:50.029+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4548493635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4548472000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F454914A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4548F46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4548C4C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4548A37000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F454881A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4548472000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4549353000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4548493635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:35:50.029+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:36:49.431+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] MongoDB starting : pid=3692 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:36:49.439+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:36:49.489+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:36:49.780+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873009:780528][3692:0x7fafc6b49c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:36:49.780+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:36:49.790+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fafc5a79635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAFC5A58000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA68D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAFC6730000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAFC652C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAFC6232000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAFC601D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAFC5E00000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAFC5A58000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAFC6939000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fafc5a79635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:36:49.791+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:37:49.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] MongoDB starting : pid=3913 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:37:49.385+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:37:49.435+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:37:49.805+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873069:805098][3913:0x7fa1378b2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:37:49.805+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:37:49.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1367e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1367C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB88FA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA137499000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA137295000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA136F9B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA136D86000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA136B69000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1367C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1376A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1367e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:37:49.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:38:49.953+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:38:49.960+0000 I CONTROL [initandlisten] MongoDB starting : pid=4076 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:38:49.960+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:38:49.960+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:38:49.961+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:38:49.961+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:38:49.961+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:38:49.961+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:38:49.961+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:38:49.961+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:38:50.013+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:38:50.350+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873130:350267][4076:0x7fb81d7b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:38:50.350+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:38:50.369+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb81c6e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB81C6C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB81D39F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB81D19B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB81CEA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB81CC8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB81CA6F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB81C6C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB81D5A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb81c6e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:38:50.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:39:49.492+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] MongoDB starting : pid=4339 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:39:49.501+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:39:49.551+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:39:49.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873189:795921][4339:0x7f09b676cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:39:49.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:39:49.806+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09b569c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09B567B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD203A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09B6353000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09B614F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09B5E55000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09B5C40000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09B5A23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09B567B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09B655C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09b569c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:39:49.806+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:40:49.926+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] MongoDB starting : pid=4583 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:40:49.934+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:40:49.985+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:40:50.362+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873250:362815][4583:0x7f3bdbc5ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:40:50.362+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:40:50.383+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3bdab8a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3BDAB69000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BDB841000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BDB63D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BDB343000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BDB12E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BDAF11000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BDAB69000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BDBA4A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3bdab8a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:40:50.383+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:41:49.798+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=4807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:41:49.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:41:49.855+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:41:50.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873310:218732][4807:0x7fdb1abb3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:41:50.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:41:50.238+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb19ae3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB19AC2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB1A79A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB1A596000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB1A29C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB1A087000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB19E6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB19AC2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB1A9A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb19ae3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:41:50.238+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:42:49.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=5202 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:42:49.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:42:49.948+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:42:50.256+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873370:256552][5202:0x7f7a62dbac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:42:50.256+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:42:50.268+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a61cea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A61CC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6834000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A629A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A6279D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A624A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A6228E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A62071000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A61CC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A62BAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a61cea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:42:50.268+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:43:49.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:43:49.423+0000 I CONTROL [initandlisten] MongoDB starting : pid=5482 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:43:49.424+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:43:49.475+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:43:49.766+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873429:766357][5482:0x7f3fa4cc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:43:49.766+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:43:49.777+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3fa3bf9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3FA3BD8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3FA48B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3FA46AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3FA43B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3FA419D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3FA3F80000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3FA3BD8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3FA4AB9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3fa3bf9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:43:49.777+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:44:49.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=5915 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:44:49.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:44:49.972+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:44:50.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873490:274429][5915:0x7fa7e6b81c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:44:50.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:44:50.284+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7e5ab1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7E5A90000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF010FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7E6768000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7E6564000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7E626A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7E6055000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7E5E38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7E5A90000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7E6971000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7e5ab1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:44:50.284+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:45:49.407+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] MongoDB starting : pid=6130 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:45:49.414+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:45:49.465+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:45:49.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873549:795547][6130:0x7f3ed8985c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:45:49.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:45:49.814+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3ed78b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3ED7894000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1E6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3ED856C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3ED8368000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3ED806E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3ED7E59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3ED7C3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3ED7894000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3ED8775000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3ed78b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:45:49.815+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:46:49.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=6473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:46:49.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:46:49.288+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:46:49.671+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873609:671359][6473:0x7f42d3a0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:46:49.671+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:46:49.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f42d293a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F42D2919000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F42D35F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F42D33ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F42D30F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F42D2EDE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F42D2CC1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F42D2919000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F42D37FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f42d293a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:46:49.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:47:49.106+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] MongoDB starting : pid=6711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:47:49.114+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:47:49.163+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:47:49.432+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873669:432870][6711:0x7ff2f6527c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:47:49.432+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:47:49.443+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff2f5457635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF2F5436000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF2F610E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF2F5F0A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2F5C10000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF2F59FB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF2F57DE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF2F5436000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF2F6317000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff2f5457635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:47:49.443+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:48:49.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] MongoDB starting : pid=6972 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:48:49.582+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:48:49.632+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:48:49.973+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873729:973735][6972:0x7f6880f89c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:48:49.973+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:48:49.984+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f687feb9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F687FE98000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97C57000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6880B70000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F688096C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6880672000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F688045D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6880240000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F687FE98000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6880D79000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f687feb9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:48:49.984+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:49:49.108+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] MongoDB starting : pid=7088 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:49:49.116+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:49:49.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:49:49.167+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:49:49.455+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873789:455647][7088:0x7f39bfb72c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:49:49.455+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:49:49.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39beaa2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F39BEA81000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39BF759000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39BF555000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39BF25B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39BF046000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39BEE29000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F39BEA81000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F39BF962000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39beaa2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:49:49.475+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:50:49.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] MongoDB starting : pid=7387 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:50:49.611+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:50:49.663+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:50:50.027+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873850:27918][7387:0x7f0c7ea85c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:50:50.028+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:50:50.047+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c7d9b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C7D994000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3C894000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C7E66C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C7E468000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C7E16E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C7DF59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C7DD3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C7D994000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C7E875000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c7d9b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:50:50.047+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:51:49.460+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] MongoDB starting : pid=7599 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:51:49.468+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:51:49.519+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:51:49.827+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873909:827408][7599:0x7fa84a834c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:51:49.827+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:51:49.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa849764635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA849743000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA86FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA84A41B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA84A217000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA849F1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA849D08000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA849AEB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA849743000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA84A624000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa849764635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:51:49.838+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:52:49.241+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=7830 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:52:49.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:52:49.300+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:52:49.592+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507873969:592710][7830:0x7fc3e75fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:52:49.592+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:52:49.616+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc3e652c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC3E650B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4E99000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3E71E3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3E6FDF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3E6CE5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3E6AD0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3E68B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3E650B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3E73EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc3e652c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:52:49.616+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:53:49.743+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] MongoDB starting : pid=8077 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:53:49.751+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:53:49.810+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:53:50.188+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874030:188658][8077:0x7fed19d39c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:53:50.188+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:53:50.199+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed18c69635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED18C48000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B9C3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED19920000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED1971C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED19422000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED1920D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED18FF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED18C48000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED19B29000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed18c69635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:53:50.199+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:54:49.323+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=8191 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:54:49.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:54:49.381+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:54:49.671+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874089:671176][8191:0x7f5a267ffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:54:49.671+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:54:49.681+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a2572f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A2570E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A263E6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A261E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A25EE8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A25CD3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A25AB6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A2570E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A265EF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a2572f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:54:49.681+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:55:49.818+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] MongoDB starting : pid=8504 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:55:49.826+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:55:49.877+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:55:50.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874150:306557][8504:0x7fa934495c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:55:50.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:55:50.325+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9333c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9333A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA93407C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA933E78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA933B7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA933969000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA93374C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9333A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA934285000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9333c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:55:50.325+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:56:49.724+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:56:49.732+0000 I CONTROL [initandlisten] MongoDB starting : pid=8708 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:56:49.732+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:56:49.733+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:56:49.786+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:56:50.119+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874210:119558][8708:0x7f5a3bd88c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:56:50.119+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:56:50.130+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a3acb8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A3AC97000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC54DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A3B96F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A3B76B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A3B471000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A3B25C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A3B03F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A3AC97000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A3BB78000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a3acb8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:56:50.130+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:57:49.507+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] MongoDB starting : pid=8936 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:57:49.515+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:57:49.568+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:57:49.834+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874269:834353][8936:0x7fd7eb338c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:57:49.834+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:57:49.854+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7ea268635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7EA247000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7EAF1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7EAD1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7EAA21000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7EA80C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7EA5EF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7EA247000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7EB128000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7ea268635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:57:49.854+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:58:49.979+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] MongoDB starting : pid=9201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:58:49.987+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:58:50.037+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:58:50.406+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874330:406015][9201:0x7f703fe79c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:58:50.406+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:58:50.425+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f703eda9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F703ED88000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F703FA60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F703F85C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F703F562000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F703F34D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F703F130000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F703ED88000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F703FC69000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f703eda9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:58:50.425+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T05:59:49.563+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] MongoDB starting : pid=9319 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] modules: none 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] build environment: 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T05:59:49.571+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T05:59:49.622+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T05:59:49.943+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874389:943008][9319:0x7ff040785c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T05:59:49.943+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T05:59:49.955+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff03f6b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF03F694000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC9DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF04036C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF040168000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF03FE6E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF03FC59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF03FA3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF03F694000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF040575000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff03f6b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T05:59:49.955+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:00:49.250+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] MongoDB starting : pid=9666 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:00:49.259+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:00:49.309+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:00:49.764+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874449:764811][9666:0x7f0913219c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:00:49.764+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:00:49.784+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0912149635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0912128000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBA713000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0912E00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0912BFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0912902000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09126ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09124D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0912128000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0913009000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0912149635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:00:49.784+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:01:49.207+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] MongoDB starting : pid=9873 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:01:49.215+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:01:49.264+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:01:49.667+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874509:667555][9873:0x7f817eb39c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:01:49.667+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:01:49.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f817da69635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F817DA48000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF234C7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F817E720000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F817E51C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F817E222000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F817E00D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F817DDF0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F817DA48000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F817E929000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f817da69635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:01:49.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:02:49.716+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] MongoDB starting : pid=10104 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:02:49.724+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:02:49.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:02:50.157+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874570:157163][10104:0x7f6fc8b4ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:02:50.157+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:02:50.176+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6fc7a7e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6FC7A5D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF78F29000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6FC8735000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6FC8531000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6FC8237000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6FC8022000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6FC7E05000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6FC7A5D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6FC893E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6fc7a7e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:02:50.177+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:03:49.316+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] MongoDB starting : pid=10354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:03:49.324+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:03:49.375+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:03:49.710+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874629:710765][10354:0x7f2aec4a8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:03:49.710+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:03:49.722+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2aeb3d8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2AEB3B7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3ADA6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2AEC08F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2AEBE8B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2AEBB91000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2AEB97C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2AEB75F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2AEB3B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2AEC298000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2aeb3d8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:03:49.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:04:49.851+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:04:49.858+0000 I CONTROL [initandlisten] MongoDB starting : pid=10471 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:04:49.858+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:04:49.858+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:04:49.858+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:04:49.858+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:04:49.858+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:04:49.859+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:04:49.859+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:04:49.859+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:04:49.909+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:04:50.216+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874690:216063][10471:0x7f43a8639c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:04:50.216+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:04:50.226+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f43a7569635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F43A7548000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8F870000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F43A8220000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F43A801C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F43A7D22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43A7B0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F43A78F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F43A7548000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F43A8429000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f43a7569635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:04:50.226+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:05:49.354+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] MongoDB starting : pid=10776 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:05:49.362+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:05:49.412+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:05:49.777+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874749:777484][10776:0x7f12e2f3dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:05:49.777+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:05:49.790+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12e1e6d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12E1E4C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12E2B24000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12E2920000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12E2626000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F12E2411000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F12E21F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12E1E4C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12E2D2D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12e1e6d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:05:49.790+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:06:49.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] MongoDB starting : pid=10982 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:06:49.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:06:49.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:06:49.623+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874809:623337][10982:0x7ff5ea6e5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:06:49.623+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:06:49.633+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff5e9615635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF5E95F4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF5EA2CC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF5EA0C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF5E9DCE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF5E9BB9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF5E999C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF5E95F4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF5EA4D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff5e9615635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:06:49.633+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:07:49.389+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] MongoDB starting : pid=11201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:07:49.397+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:07:49.447+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:07:49.793+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874869:793615][11201:0x7f3413fc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:07:49.793+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:07:49.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3412ef9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3412ED8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF12C82000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3413BB0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34139AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34136B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F341349D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3413280000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3412ED8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3413DB9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3412ef9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:07:49.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:08:49.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] MongoDB starting : pid=11457 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:08:49.956+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:08:50.006+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:08:50.308+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874930:308914][11457:0x7f80b9e4fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:08:50.308+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:08:50.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80b8d7f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80B8D5E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80B9A36000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80B9832000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80B9538000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80B9323000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80B9106000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80B8D5E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80B9C3F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80b8d7f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:08:50.320+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:09:49.447+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] MongoDB starting : pid=11581 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:09:49.455+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:09:49.506+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:09:49.884+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507874989:884093][11581:0x7f9479b33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:09:49.884+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:09:49.903+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9478a63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9478A42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB3CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F947971A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9479516000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F947921C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9479007000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9478DEA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9478A42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9479923000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9478a63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:09:49.903+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:10:50.042+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] MongoDB starting : pid=11879 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:10:50.050+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:10:50.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:10:50.358+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875050:358576][11879:0x7fb16400fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:10:50.358+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:10:50.369+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb162f3f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB162F1E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB163BF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1639F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB1636F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB1634E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1632C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB162F1E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB163DFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb162f3f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:10:50.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:11:49.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=12087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:11:49.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:11:49.820+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:11:50.097+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875110:97514][12087:0x7fe8e5550c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:11:50.097+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:11:50.116+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe8e4480635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE8E445F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD44AC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE8E5137000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE8E4F33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE8E4C39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE8E4A24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE8E4807000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE8E445F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE8E5340000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe8e4480635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:11:50.117+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:12:49.752+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] MongoDB starting : pid=12391 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:12:49.760+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:12:49.811+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:12:50.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875170:173578][12391:0x7fe1ec503c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:12:50.173+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:12:50.187+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1eb433635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1EB412000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1EC0EA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1EBEE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1EBBEC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1EB9D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1EB7BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1EB412000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1EC2F3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1eb433635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:12:50.187+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:13:49.311+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] MongoDB starting : pid=12651 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:13:49.319+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:13:49.369+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:13:49.702+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875229:702677][12651:0x7f2e67949c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:13:49.702+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:13:49.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e66879635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E66858000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DEBF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E67530000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E6732C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E67032000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E66E1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E66C00000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E66858000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E67739000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e66879635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:13:49.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:14:49.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=12768 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:14:49.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:14:49.900+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:14:50.282+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875290:282820][12768:0x7f9fad64ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:14:50.282+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:14:50.302+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9fac57a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9FAC559000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD43EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9FAD231000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9FAD02D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9FACD33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9FACB1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9FAC901000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9FAC559000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9FAD43A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9fac57a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:14:50.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:15:49.419+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] MongoDB starting : pid=13080 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:15:49.425+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:15:49.454+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:15:49.739+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875349:739858][13080:0x7fba86391c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:15:49.739+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:15:49.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba852c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA852A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA85F78000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA85D74000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA85A7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA85865000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA85648000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA852A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA86181000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba852c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:15:49.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:16:49.156+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] MongoDB starting : pid=13326 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:16:49.164+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:16:49.216+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:16:49.566+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875409:566507][13326:0x7fd80cfa9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:16:49.566+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:16:49.578+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd80bed9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD80BEB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF156FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD80CB90000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD80C98C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD80C692000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD80C47D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD80C260000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD80BEB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD80CD99000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd80bed9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:16:49.578+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:17:49.102+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:17:49.110+0000 I CONTROL [initandlisten] MongoDB starting : pid=13559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:17:49.111+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:17:49.160+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:17:49.502+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875469:502632][13559:0x7f386776dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:17:49.502+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:17:49.513+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f386669d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F386667C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C0BD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3867354000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3867150000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3866E56000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3866C41000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3866A24000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F386667C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F386755D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f386669d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:17:49.513+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:18:49.636+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] MongoDB starting : pid=13807 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:18:49.643+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:18:49.694+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:18:50.028+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875530:28162][13807:0x7f5ab634ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:18:50.028+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:18:50.049+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ab527a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AB5259000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD2FFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AB5F31000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AB5D2D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AB5A33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AB581E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AB5601000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AB5259000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AB613A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ab527a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:18:50.049+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:19:49.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] MongoDB starting : pid=13921 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:19:49.178+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:19:49.227+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:19:49.541+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875589:541676][13921:0x7fac476bfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:19:49.541+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:19:49.553+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac465ef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC465CE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAF0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC472A6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC470A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC46DA8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC46B93000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC46976000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC465CE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC474AF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac465ef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:19:49.553+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:20:49.683+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] MongoDB starting : pid=14158 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:20:49.691+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:20:49.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:20:50.102+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875650:102194][14158:0x7fddf5ee1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:20:50.102+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:20:50.121+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fddf4e11635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDDF4DF0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF48FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDDF5AC8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDDF58C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDDF55CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDDF53B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDDF5198000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDDF4DF0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDDF5CD1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fddf4e11635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:20:50.121+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:21:49.562+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] MongoDB starting : pid=14327 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:21:49.570+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:21:49.619+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:21:49.892+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875709:892331][14327:0x7fe0da4e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:21:49.892+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:21:49.912+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0d9417635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0D93F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEBEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0DA0CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE0D9ECA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE0D9BD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE0D99BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE0D979E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0D93F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0DA2D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0d9417635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:21:49.912+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:22:49.392+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] MongoDB starting : pid=14876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:22:49.399+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:22:49.452+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:22:49.778+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875769:778818][14876:0x7f1344659c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:22:49.778+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:22:49.789+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1343589635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1343568000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF47A3A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1344240000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F134403C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1343D42000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1343B2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1343910000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1343568000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1344449000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1343589635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:22:49.789+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:23:49.913+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:23:49.920+0000 I CONTROL [initandlisten] MongoDB starting : pid=15149 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:23:49.920+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:23:49.921+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:23:49.971+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:23:50.309+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875830:309858][15149:0x7f0bb61d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:23:50.309+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:23:50.329+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0bb5107635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0BB50E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7AE42000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0BB5DBE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0BB5BBA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0BB58C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0BB56AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0BB548E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0BB50E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0BB5FC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0bb5107635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:23:50.329+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:24:49.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] MongoDB starting : pid=15359 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:24:49.469+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:24:49.519+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:24:49.814+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875889:814304][15359:0x7fb05100bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:24:49.814+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:24:49.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb04ff3b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB04FF1A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDDEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB050BF2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0509EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0506F4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0504DF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0502C2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB04FF1A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB050DFB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb04ff3b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:24:49.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:25:49.963+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] MongoDB starting : pid=15524 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:25:49.971+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:25:50.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:25:50.324+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507875950:324692][15524:0x7f49711eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:25:50.324+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:25:50.335+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f497011e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F49700FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC15DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4970DD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4970BD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F49708D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F49706C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F49704A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F49700FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4970FDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f497011e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:25:50.335+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:26:49.810+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=15781 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:26:49.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:26:49.869+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:26:50.231+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876010:231351][15781:0x7f0807ddec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:26:50.231+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:26:50.242+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0806d0e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0806CED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF074FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F08079C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F08077C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F08074C7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F08072B2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0807095000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0806CED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0807BCE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0806d0e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:26:50.242+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:27:49.379+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] MongoDB starting : pid=16004 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:27:49.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:27:49.438+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:27:49.801+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876069:801290][16004:0x7fa287fefc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:27:49.801+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:27:49.811+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa286f1f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA286EFE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAF052000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA287BD6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA2879D2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA2876D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA2874C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA2872A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA286EFE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA287DDF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa286f1f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:27:49.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:28:49.915+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] MongoDB starting : pid=16248 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:28:49.923+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:28:49.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:28:50.379+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876130:379705][16248:0x7ffd22c08c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:28:50.379+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:28:50.399+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd21b38635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD21B17000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF35CB0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD227EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD225EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD222F1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD220DC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD21EBF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD21B17000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD229F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd21b38635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:28:50.399+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:29:49.530+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] MongoDB starting : pid=16458 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:29:49.538+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:29:49.588+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:29:49.928+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876189:928816][16458:0x7f9c6ffcdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:29:49.928+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:29:49.939+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c6eefd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C6EEDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF196FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C6FBB4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C6F9B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C6F6B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C6F4A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C6F284000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C6EEDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C6FDBD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c6eefd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:29:49.939+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:30:49.066+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=16619 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:30:49.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:30:49.124+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:30:49.432+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876249:432569][16619:0x7f3d0509ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:30:49.432+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:30:49.452+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d03fca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D03FA9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF55CEF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D04C81000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D04A7D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D04783000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D0456E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D04351000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D03FA9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D04E8A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d03fca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:30:49.452+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:31:49.870+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] MongoDB starting : pid=16888 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:31:49.878+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:31:49.928+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:31:50.318+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876310:318885][16888:0x7fd4e41dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:31:50.318+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:31:50.338+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd4e310f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD4E30EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6CFB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD4E3DC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD4E3BC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD4E38C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD4E36B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD4E3496000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD4E30EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD4E3FCF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd4e310f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:31:50.338+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:32:49.468+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] MongoDB starting : pid=17115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:32:49.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:32:49.528+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:32:49.836+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876369:836744][17115:0x7f16e69b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:32:49.836+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:32:49.847+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16e58e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16E58C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F16E659B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F16E6397000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F16E609D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F16E5E88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F16E5C6B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16E58C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F16E67A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16e58e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:32:49.847+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:33:49.184+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] MongoDB starting : pid=17351 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:33:49.192+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:33:49.242+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:33:49.510+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876429:510070][17351:0x7f30fef78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:33:49.510+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:33:49.520+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30fdea8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F30FDE87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0C6B3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F30FEB5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F30FE95B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F30FE661000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F30FE44C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F30FE22F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F30FDE87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F30FED68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30fdea8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:33:49.520+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:34:49.643+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] MongoDB starting : pid=17566 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:34:49.650+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:34:49.702+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:34:50.087+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876490:87535][17566:0x7f372e65fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:34:50.087+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:34:50.107+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f372d58f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F372D56E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F372E246000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F372E042000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F372DD48000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F372DB33000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F372D916000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F372D56E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F372E44F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f372d58f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:34:50.108+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:35:49.240+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:35:49.251+0000 I CONTROL [initandlisten] MongoDB starting : pid=17728 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:35:49.252+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:35:49.314+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:35:49.685+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876549:685718][17728:0x7f63b1110c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:35:49.685+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:35:49.705+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63b0040635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63B001F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4BE98000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63B0CF7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63B0AF3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F63B07F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63B05E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63B03C7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63B001F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F63B0F00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63b0040635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:35:49.705+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:36:49.126+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:36:49.133+0000 I CONTROL [initandlisten] MongoDB starting : pid=17991 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:36:49.134+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:36:49.183+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:36:49.519+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876609:519407][17991:0x7f3ee13e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:36:49.519+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:36:49.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3ee0316635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3EE02F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3EE0FCD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3EE0DC9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3EE0ACF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3EE08BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3EE069D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3EE02F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3EE11D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3ee0316635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:36:49.530+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:37:49.650+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] MongoDB starting : pid=18214 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:37:49.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:37:49.708+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:37:50.106+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876670:106694][18214:0x7ff80c7bdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:37:50.106+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:37:50.127+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff80b6ed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF80B6CC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF466D7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF80C3A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF80C1A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF80BEA6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF80BC91000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF80BA74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF80B6CC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF80C5AD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff80b6ed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:37:50.127+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:38:49.402+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] MongoDB starting : pid=18450 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:38:49.410+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:38:49.461+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:38:49.880+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876729:880145][18450:0x7fa887e4bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:38:49.880+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:38:49.899+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa886d7b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA886D5A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06A85000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA887A32000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA88782E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA887534000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA88731F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA887102000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA886D5A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA887C3B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa886d7b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:38:49.899+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:39:50.029+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] MongoDB starting : pid=18665 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:39:50.037+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:39:50.087+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:39:50.372+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876790:372928][18665:0x7fa8e88dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:39:50.372+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:39:50.383+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8e780b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8E77EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF246FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8E84C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8E82BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8E7FC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8E7DAF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8E7B92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8E77EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8E86CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8e780b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:39:50.383+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:40:49.500+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] MongoDB starting : pid=18828 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:40:49.504+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:40:49.531+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:40:49.782+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876849:782948][18828:0x7fc672d0dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:40:49.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:40:49.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc671c3d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC671C1C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF07DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC6728F4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC6726F0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC6723F6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC6721E1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC671FC4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC671C1C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC672AFD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc671c3d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:40:49.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:41:49.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=19096 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:41:49.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:41:49.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:41:49.531+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876909:531533][19096:0x7fdfdcaebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:41:49.531+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:41:49.550+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdfdba1b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFDB9FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62E7C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFDC6D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFDC4CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFDC1D4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFDBFBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFDBDA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFDB9FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFDC8DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdfdba1b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:41:49.550+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:42:49.680+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] MongoDB starting : pid=19335 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:42:49.688+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:42:49.737+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:42:50.092+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507876970:92475][19335:0x7f0a24e8dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:42:50.092+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:42:50.107+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a23dbd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A23D9C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA70FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A24A74000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A24870000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A24576000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A24361000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A24144000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A23D9C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A24C7D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a23dbd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:42:50.107+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:43:49.862+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] MongoDB starting : pid=19594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:43:49.870+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:43:49.919+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:43:50.186+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877030:186487][19594:0x7fd27f7e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:43:50.186+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:43:50.197+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd27e716635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD27E6F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD27F3CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD27F1C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD27EECF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD27ECBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD27EA9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD27E6F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD27F5D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd27e716635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:43:50.197+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:44:49.332+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] MongoDB starting : pid=19806 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:44:49.341+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:44:49.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:44:49.738+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877089:738404][19806:0x7fb184134c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:44:49.738+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:44:49.751+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb183064635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB183043000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97457000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB183D1B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB183B17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB18381D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB183608000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1833EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB183043000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB183F24000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb183064635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:44:49.751+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:45:49.875+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] MongoDB starting : pid=19963 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:45:49.883+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:45:49.935+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:45:50.241+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877150:241062][19963:0x7f651706fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:45:50.241+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:45:50.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6515f9f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6515F7E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA2FF2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6516C56000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6516A52000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6516758000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6516543000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6516326000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6515F7E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6516E5F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6515f9f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:45:50.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:46:49.655+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] MongoDB starting : pid=20228 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:46:49.662+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:46:49.663+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:46:49.663+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:46:49.728+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:46:50.120+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877210:120644][20228:0x7f0b54f7cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:46:50.120+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:46:50.139+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0b53eac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0B53E8B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB24FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0B54B63000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0B5495F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0B54665000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0B54450000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0B54233000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0B53E8B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0B54D6C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0b53eac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:46:50.140+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:47:49.258+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=20451 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:47:49.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:47:49.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:47:49.716+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877269:716225][20451:0x7f5e163ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:47:49.716+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:47:49.736+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e1531b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E152FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFED0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E15FD2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E15DCE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E15AD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E158BF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E156A2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E152FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E161DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e1531b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:47:49.736+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:48:50.018+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:48:50.025+0000 I CONTROL [initandlisten] MongoDB starting : pid=20687 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:48:50.025+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:48:50.025+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:48:50.026+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:48:50.026+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:48:50.026+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:48:50.026+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:48:50.026+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:48:50.026+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:48:50.075+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:48:50.462+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877330:462538][20687:0x7f75bf219c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:48:50.462+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:48:50.482+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f75be149635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F75BE128000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F75BEE00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F75BEBFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F75BE902000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F75BE6ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F75BE4D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F75BE128000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F75BF009000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f75be149635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:48:50.482+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:49:49.603+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] MongoDB starting : pid=20924 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:49:49.611+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:49:49.661+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:49:50.066+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877390:66677][20924:0x7f3150192c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:49:50.066+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:49:50.086+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f314f0c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F314F0A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98AEB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F314FD79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F314FB75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F314F87B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F314F666000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F314F449000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F314F0A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F314FF82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f314f0c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:49:50.086+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:50:49.217+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] MongoDB starting : pid=21082 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:50:49.225+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:50:49.275+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:50:49.537+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877449:537612][21082:0x7f5b6cd02c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:50:49.537+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:50:49.548+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5b6bc32635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5B6BC11000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5B6C8E9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5B6C6E5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5B6C3EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5B6C1D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5B6BFB9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5B6BC11000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5B6CAF2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5b6bc32635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:50:49.548+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:51:49.953+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] MongoDB starting : pid=21351 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:51:49.961+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:51:50.011+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:51:50.357+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877510:357420][21351:0x7f52c1e0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:51:50.357+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:51:50.371+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52c0d3a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52C0D19000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52C19F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52C17ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52C14F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52C12DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52C10C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52C0D19000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52C1BFA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52c0d3a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:51:50.371+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:52:49.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] MongoDB starting : pid=21581 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:52:49.506+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:52:49.555+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:52:49.898+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877569:898187][21581:0x7f6d7b8e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:52:49.898+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:52:49.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6d7a817635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6D7A7F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6D7B4CE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6D7B2CA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6D7AFD0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6D7ADBB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6D7AB9E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6D7A7F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6D7B6D7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6d7a817635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:52:49.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:53:49.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=21812 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:53:49.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:53:49.288+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:53:49.612+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877629:612415][21812:0x7ff0d440ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:53:49.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:53:49.631+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff0d333e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0D331D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA768D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF0D3FF5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF0D3DF1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF0D3AF7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF0D38E2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF0D36C5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0D331D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF0D41FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff0d333e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:53:49.631+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:54:49.762+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=22044 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:54:49.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:54:49.819+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:54:50.190+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877690:190139][22044:0x7ffb1ff6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:54:50.190+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:54:50.209+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb1ee9d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB1EE7C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF896FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB1FB54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB1F950000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB1F656000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB1F441000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB1F224000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB1EE7C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB1FD5D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb1ee9d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:54:50.209+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:55:49.334+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] MongoDB starting : pid=22203 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:55:49.341+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:55:49.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:55:49.838+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877749:838791][22203:0x7f0c92fffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:55:49.838+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:55:49.859+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c91f2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C91F0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74AED000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C92BE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C929E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C926E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C924D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C922B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C91F0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C92DEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c91f2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:55:49.859+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:56:49.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] MongoDB starting : pid=22316 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:56:49.299+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:56:49.350+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:56:49.698+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877809:698154][22316:0x7f02607a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:56:49.698+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:56:49.709+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f025f6d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F025F6AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70E42000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0260387000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0260183000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F025FE89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F025FC74000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F025FA57000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F025F6AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0260590000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f025f6d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:56:49.709+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:57:49.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] MongoDB starting : pid=22599 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:57:49.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:57:49.901+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:57:50.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877870:209807][22599:0x7fe551e73c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:57:50.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:57:50.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe550da3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE550D82000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF90AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE551A5A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE551856000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE55155C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE551347000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE55112A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE550D82000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE551C63000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe550da3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:57:50.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:58:49.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] MongoDB starting : pid=22829 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:58:49.557+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:58:49.608+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:58:50.002+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877930:2688][22829:0x7fa3785d9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:58:50.002+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:58:50.022+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa377509635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3774E8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D2B5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3781C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA377FBC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA377CC2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA377AAD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA377890000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3774E8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3783C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa377509635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:58:50.022+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T06:59:49.147+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] MongoDB starting : pid=23055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] modules: none 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] build environment: 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T06:59:49.155+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T06:59:49.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T06:59:49.612+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507877989:612866][23055:0x7fedc5eeec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T06:59:49.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T06:59:49.632+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fedc4e1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEDC4DFD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85722000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEDC5AD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEDC58D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEDC55D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEDC53C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEDC51A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEDC4DFD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEDC5CDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fedc4e1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T06:59:49.632+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:00:49.767+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] MongoDB starting : pid=23302 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:00:49.775+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:00:49.825+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:00:50.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878050:173626][23302:0x7f2628f0bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:00:50.173+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:00:50.193+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2627e3b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2627E1A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF6083000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2628AF2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F26288EE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F26285F4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F26283DF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F26281C2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2627E1A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2628CFB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2627e3b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:00:50.193+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:01:49.579+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] MongoDB starting : pid=23428 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:01:49.587+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:01:49.637+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:01:50.065+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878110:65968][23428:0x7fb684d58c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:01:50.066+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:01:50.085+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb683c88635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB683C67000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FE8F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB68493F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB68473B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB684441000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB68422C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB68400F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB683C67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB684B48000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb683c88635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:01:50.085+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:02:49.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] MongoDB starting : pid=23721 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:02:49.707+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:02:49.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:02:50.169+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878170:169954][23721:0x7f1826f36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:02:50.170+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:02:50.189+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1825e66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1825E45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3FEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1826B1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1826919000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F182661F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F182640A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18261ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1825E45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1826D26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1825e66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:02:50.189+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:03:49.806+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] MongoDB starting : pid=23932 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:03:49.814+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:03:49.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:03:50.230+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878230:230736][23932:0x7f33c01aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:03:50.230+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:03:50.250+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33bf0da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33BF0B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19882000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33BFD91000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33BFB8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33BF893000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33BF67E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33BF461000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33BF0B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33BFF9A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33bf0da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:03:50.250+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:04:49.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] MongoDB starting : pid=24166 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:04:49.386+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:04:49.436+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:04:49.888+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878289:888821][24166:0x7ff01bf36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:04:49.888+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:04:49.907+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff01ae66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF01AE45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0E7A6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF01BB1D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF01B919000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF01B61F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF01B40A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF01B1ED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF01AE45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF01BD26000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff01ae66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:04:49.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:05:50.032+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] MongoDB starting : pid=24401 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:05:50.040+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:05:50.091+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:05:50.407+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878350:407808][24401:0x7f40b9187c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:05:50.407+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:05:50.418+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40b80b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40B8096000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E4DC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40B8D6E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40B8B6A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40B8870000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40B865B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40B843E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40B8096000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40B8F77000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40b80b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:05:50.418+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:06:49.816+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] MongoDB starting : pid=24528 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:06:49.824+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:06:49.874+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:06:50.177+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878410:177545][24528:0x7effd7c66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:06:50.177+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:06:50.188+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7effd6b96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFD6B75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF350FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFD784D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFD7649000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFD734F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFD713A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFD6F1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFD6B75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFD7A56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7effd6b96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:06:50.188+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:07:49.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=24802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:07:49.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:07:49.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:07:49.729+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878469:729838][24802:0x7f68f126dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:07:49.729+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:07:49.740+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f68f019d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F68F017C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F68F0E54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F68F0C50000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F68F0956000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F68F0741000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F68F0524000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F68F017C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F68F105D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f68f019d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:07:49.740+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:08:49.111+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] MongoDB starting : pid=25010 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:08:49.121+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:08:49.172+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:08:49.567+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878529:567718][25010:0x7fb84c099c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:08:49.567+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:08:49.587+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb84afc9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB84AFA8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9CD59000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB84BC80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB84BA7C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB84B782000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB84B56D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB84B350000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB84AFA8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB84BE89000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb84afc9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:08:49.587+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:09:49.710+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] MongoDB starting : pid=25258 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:09:49.718+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:09:49.768+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:09:50.101+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878590:101289][25258:0x7fe57459dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:09:50.101+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:09:50.120+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe5734cd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE5734AC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF07F6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE574184000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE573F80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE573C86000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE573A71000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE573854000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE5734AC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE57438D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe5734cd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:09:50.120+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:10:49.257+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:10:49.267+0000 I CONTROL [initandlisten] MongoDB starting : pid=25494 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:10:49.267+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:10:49.267+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:10:49.267+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:10:49.268+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:10:49.268+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:10:49.268+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:10:49.268+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:10:49.268+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:10:49.318+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:10:49.712+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878649:712353][25494:0x7f18be079c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:10:49.712+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:10:49.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18bcfa9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18BCF88000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB3CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18BDC60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18BDA5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18BD762000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18BD54D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18BD330000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18BCF88000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18BDE69000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18bcfa9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:10:49.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:11:49.171+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=25626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:11:49.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:11:49.230+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:11:49.613+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878709:613915][25626:0x7fd71e15ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:11:49.614+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:11:49.633+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd71d08e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD71D06D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BD8A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD71DD45000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD71DB41000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD71D847000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD71D632000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD71D415000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD71D06D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD71DF4E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd71d08e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:11:49.633+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:12:49.764+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] MongoDB starting : pid=25908 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:12:49.773+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:12:49.828+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:12:50.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878770:209222][25908:0x7f5ea3e92c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:12:50.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:12:50.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ea2dc2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5EA2DA1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE228A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5EA3A79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5EA3875000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5EA357B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5EA3366000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5EA3149000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5EA2DA1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5EA3C82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ea2dc2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:12:50.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:13:49.341+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:13:49.350+0000 I CONTROL [initandlisten] MongoDB starting : pid=26124 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:13:49.351+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:13:49.406+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:13:49.706+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878829:706188][26124:0x7f38c1bc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:13:49.706+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:13:49.717+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f38c0af3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F38C0AD2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF296D6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F38C17AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38C15A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F38C12AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F38C1097000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38C0E7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38C0AD2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38C19B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f38c0af3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:13:49.717+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:14:49.842+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] MongoDB starting : pid=26370 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:14:49.849+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:14:49.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:14:50.268+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878890:268116][26370:0x7fc0fb533c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:14:50.268+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:14:50.288+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc0fa463635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC0FA442000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF188FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC0FB11A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC0FAF16000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC0FAC1C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC0FAA07000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC0FA7EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC0FA442000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC0FB323000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc0fa463635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:14:50.288+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:15:49.408+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] MongoDB starting : pid=26594 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:15:49.416+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:15:49.467+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:15:49.785+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507878949:785650][26594:0x7f96d2a7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:15:49.785+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:15:49.804+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96d19ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96D198C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF344FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96D2664000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96D2460000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96D2166000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96D1F51000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96D1D34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96D198C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96D286D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96d19ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:15:49.804+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:16:49.194+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] MongoDB starting : pid=26735 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:16:49.203+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:16:49.253+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:16:49.625+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879009:625292][26735:0x7f4b30eb8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:16:49.625+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:16:49.638+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4b2fde8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4B2FDC7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2A88000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4B30A9F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4B3089B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4B305A1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4B3038C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4B3016F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4B2FDC7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4B30CA8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4b2fde8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:16:49.638+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:17:49.778+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=27014 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:17:49.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:17:49.836+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:17:50.141+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879070:141564][27014:0x7f39d80f9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:17:50.141+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:17:50.152+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39d7029635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F39D7008000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39D7CE0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39D7ADC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39D77E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39D75CD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39D73B0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F39D7008000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F39D7EE9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39d7029635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:17:50.152+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:18:49.617+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] MongoDB starting : pid=27224 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:18:49.625+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:18:49.678+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:18:50.021+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879130:21907][27224:0x7f4cd10f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:18:50.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:18:50.035+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4cd0022635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4CD0001000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4CD0CD9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4CD0AD5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4CD07DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4CD05C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4CD03A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4CD0001000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4CD0EE2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4cd0022635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:18:50.035+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:19:49.172+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] MongoDB starting : pid=27463 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:19:49.179+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:19:49.229+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:19:49.531+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879189:531106][27463:0x7f428c2dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:19:49.531+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:19:49.541+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f428b20b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F428B1EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF661000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F428BEC2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F428BCBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F428B9C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F428B7AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F428B592000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F428B1EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F428C0CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f428b20b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:19:49.541+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:20:49.675+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] MongoDB starting : pid=27684 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:20:49.683+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:20:49.733+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:20:50.087+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879250:87014][27684:0x7f2a81e97c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:20:50.087+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:20:50.097+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2a80dc7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2A80DA6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF67AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2A81A7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2A8187A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2A81580000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2A8136B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2A8114E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2A80DA6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2A81C87000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2a80dc7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:20:50.098+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:21:49.519+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] MongoDB starting : pid=27833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:21:49.527+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:21:49.577+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:21:49.903+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879309:903138][27833:0x7f5da8097c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:21:49.903+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:21:49.915+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5da6fc7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5DA6FA6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA9CBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5DA7C7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5DA7A7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5DA7780000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5DA756B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5DA734E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5DA6FA6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5DA7E87000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5da6fc7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:21:49.915+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:22:50.057+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=28115 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:22:50.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:22:50.119+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:22:50.505+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879370:505678][28115:0x7f06b22f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:22:50.505+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:22:50.519+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f06b1221635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F06B1200000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF820FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F06B1ED8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F06B1CD4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F06B19DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F06B17C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F06B15A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F06B1200000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F06B20E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f06b1221635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:22:50.519+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:23:49.858+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] MongoDB starting : pid=28324 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:23:49.865+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:23:49.866+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:23:49.866+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:23:49.915+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:23:50.260+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879430:260826][28324:0x7f9bc4695c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:23:50.260+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:23:50.274+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9bc35c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9BC35A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD42FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9BC427C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9BC4078000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9BC3D7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9BC3B69000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9BC394C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9BC35A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9BC4485000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9bc35c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:23:50.274+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:24:49.402+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] MongoDB starting : pid=28561 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:24:49.411+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:24:49.462+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:24:49.820+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879489:820587][28561:0x7f3c1b5a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:24:49.820+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:24:49.832+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3c1a4d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3C1A4B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEADA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3C1B188000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3C1AF84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3C1AC8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3C1AA75000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3C1A858000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3C1A4B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3C1B391000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3c1a4d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:24:49.832+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:25:49.965+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:25:49.976+0000 I CONTROL [initandlisten] MongoDB starting : pid=28778 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:25:49.977+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:25:50.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:25:50.391+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879550:391161][28778:0x7f52f5533c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:25:50.391+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:25:50.403+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52f4463635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F52F4442000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF670FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F52F511A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F52F4F16000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F52F4C1C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F52F4A07000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F52F47EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F52F4442000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F52F5323000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52f4463635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:25:50.403+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:26:49.878+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=28925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:26:49.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:26:49.936+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:26:50.290+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879610:290221][28925:0x7f160338bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:26:50.290+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:26:50.302+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16022bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F160229A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF100FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1602F72000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1602D6E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1602A74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F160285F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1602642000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F160229A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F160317B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16022bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:26:50.302+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:27:49.436+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] MongoDB starting : pid=29198 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:27:49.444+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:27:49.495+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:27:49.918+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879669:918380][29198:0x7f05a2d28c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:27:49.918+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:27:49.938+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f05a1c58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F05A1C37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDA8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F05A290F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F05A270B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F05A2411000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F05A21FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F05A1FDF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F05A1C37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F05A2B18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f05a1c58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:27:49.938+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:28:49.399+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] MongoDB starting : pid=29412 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:28:49.406+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:28:49.458+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:28:49.810+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879729:810390][29412:0x7fd0f06a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:28:49.810+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:28:49.823+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd0ef5d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD0EF5B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92222000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD0F0290000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD0F008C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD0EFD92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD0EFB7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD0EF960000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD0EF5B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD0F0499000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd0ef5d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:28:49.823+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:29:49.940+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:29:49.947+0000 I CONTROL [initandlisten] MongoDB starting : pid=29647 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:29:49.948+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:29:49.999+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:29:50.305+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879790:305003][29647:0x7f5037257c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:29:50.305+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:29:50.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5036187635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5036166000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF2AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5036E3E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5036C3A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5036940000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F503672B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F503650E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5036166000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5037047000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5036187635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:29:50.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:30:49.446+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] MongoDB starting : pid=29801 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:30:49.468+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:30:49.519+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:30:49.926+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879849:926381][29801:0x7f3e65af2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:30:49.926+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:30:49.946+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e64a22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E64A01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF684FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E656D9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E654D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E651DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E64FC6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E64DA9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E64A01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E658E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e64a22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:30:49.946+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:31:49.410+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] MongoDB starting : pid=30013 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:31:49.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:31:49.470+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:31:49.818+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879909:818769][30013:0x7fa25e75ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:31:49.818+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:31:49.829+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa25d68e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA25D66D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2987000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA25E345000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA25E141000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA25DE47000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA25DC32000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA25DA15000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA25D66D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA25E54E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa25d68e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:31:49.829+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:32:49.960+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] MongoDB starting : pid=30151 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:32:49.968+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:32:50.020+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:32:50.439+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507879970:439243][30151:0x7f8ee3963c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:32:50.439+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:32:50.459+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ee2893635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8EE2872000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0421B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8EE354A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8EE3346000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8EE304C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8EE2E37000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8EE2C1A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8EE2872000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8EE3753000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ee2893635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:32:50.459+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:33:49.496+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] MongoDB starting : pid=30409 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:33:49.505+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:33:49.557+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:33:49.994+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880029:994134][30409:0x7f2f38720c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:33:49.994+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:33:50.016+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f37650635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F3762F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F230000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F38307000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F38103000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F37E09000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F37BF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F379D7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F3762F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F38510000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f37650635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:33:50.016+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:34:49.155+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:34:49.162+0000 I CONTROL [initandlisten] MongoDB starting : pid=30655 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:34:49.162+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:34:49.162+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:34:49.163+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:34:49.163+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:34:49.163+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:34:49.163+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:34:49.163+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:34:49.163+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:34:49.215+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:34:49.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880089:556375][30655:0x7f0a37ce6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:34:49.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:34:49.577+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a36c16635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A36BF5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A378CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A376C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A373CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A371BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A36F9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A36BF5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A37AD6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a36c16635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:34:49.577+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:35:49.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] MongoDB starting : pid=30876 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:35:49.707+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:35:49.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:35:50.110+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880150:110906][30876:0x7f603c393c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:35:50.111+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:35:50.130+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f603b2c3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F603B2A2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD28FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F603BF7A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F603BD76000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F603BA7C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F603B867000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F603B64A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F603B2A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F603C183000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f603b2c3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:35:50.130+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:36:49.555+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] MongoDB starting : pid=31119 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:36:49.562+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:36:49.612+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:36:49.934+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880209:934509][31119:0x7fd361cecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:36:49.934+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:36:49.946+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd360c1c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD360BFB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE465D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD3618D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD3616CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD3613D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD3611C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD360FA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD360BFB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD361ADC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd360c1c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:36:49.946+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:37:49.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] MongoDB starting : pid=31248 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:37:49.083+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:37:49.133+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:37:49.522+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880269:522464][31248:0x7fb0452b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:37:49.522+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:37:49.535+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0441e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0441C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEBCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB044E9D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB044C99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB04499F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB04478A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB04456D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0441C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0450A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0441e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:37:49.535+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:38:49.771+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] MongoDB starting : pid=31513 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:38:49.779+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:38:49.832+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:38:50.173+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880330:172990][31513:0x7f4e5642ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:38:50.173+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:38:50.188+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e5535e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E5533D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E56015000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E55E11000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E55B17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E55902000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E556E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E5533D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E5621E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e5535e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:38:50.188+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:39:49.321+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] MongoDB starting : pid=31756 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:39:49.328+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:39:49.378+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:39:49.696+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880389:696554][31756:0x7fda10e17c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:39:49.696+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:39:49.707+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda0fd47635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA0FD26000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA109FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA107FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA10500000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA102EB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA100CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA0FD26000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA10C07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda0fd47635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:39:49.707+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:40:49.829+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] MongoDB starting : pid=31968 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:40:49.836+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:40:49.887+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:40:50.253+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880450:253117][31968:0x7fcecece6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:40:50.253+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:40:50.272+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcecdc16635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCECDBF5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8D802000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCECE8CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCECE6C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCECE3CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCECE1BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCECDF9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCECDBF5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCECEAD6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcecdc16635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:40:50.272+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:41:49.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=32213 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:41:49.770+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:41:49.821+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:41:50.257+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880510:257503][32213:0x7fbd5637ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:41:50.257+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:41:50.280+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbd552ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBD5528D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80084000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBD55F65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBD55D61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBD55A67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBD55852000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBD55635000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBD5528D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBD5616E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbd552ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:41:50.280+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:42:49.416+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:42:49.423+0000 I CONTROL [initandlisten] MongoDB starting : pid=32350 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:42:49.424+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:42:49.477+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:42:49.894+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880569:894843][32350:0x7f83fb1aac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:42:49.894+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:42:49.914+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83fa0da635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83FA0B9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF244C3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83FAD91000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83FAB8D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83FA893000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83FA67E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83FA461000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83FA0B9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83FAF9A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83fa0da635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:42:49.914+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:43:50.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=32622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:43:50.065+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:43:50.115+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:43:50.486+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880630:486236][32622:0x7fd79e556c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:43:50.486+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:43:50.498+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd79d488635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD79D467000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FD79EE67000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD79E13F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD79DF3B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD79DC41000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD79DA2C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD79D80F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD79D467000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD79E348000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd79d488635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:43:50.498+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:44:49.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] MongoDB starting : pid=403 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:44:49.626+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:44:49.676+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:44:50.084+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880690:84727][403:0x7f6333f0fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:44:50.084+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:44:50.104+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6332e3f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6332E1E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6907E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6333AF6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63338F2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F63335F8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63333E3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63331C6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6332E1E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6333CFF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6332e3f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:44:50.104+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:45:49.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] MongoDB starting : pid=610 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:45:49.245+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:45:49.294+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:45:49.664+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880749:664335][610:0x7f18fe573c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:45:49.664+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:45:49.683+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f18fd4a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18FD482000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF86078000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F18FE15A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F18FDF56000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18FDC5C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18FDA47000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18FD82A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18FD482000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F18FE363000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f18fd4a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:45:49.683+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:46:49.154+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] MongoDB starting : pid=858 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:46:49.162+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:46:49.213+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:46:49.596+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880809:596777][858:0x7fa8ca146c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:46:49.596+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:46:49.617+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8c9076635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8C9055000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA64F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8C9D2D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8C9B29000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8C982F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8C961A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8C93FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8C9055000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8C9F36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8c9076635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:46:49.617+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:47:49.751+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] MongoDB starting : pid=998 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:47:49.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:47:49.810+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:47:50.172+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880870:172893][998:0x7f312826bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:47:50.172+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:47:50.192+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f312719b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F312717A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF02CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3127E52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3127C4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3127954000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F312773F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3127522000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F312717A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F312805B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f312719b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:47:50.192+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:48:49.246+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] MongoDB starting : pid=1274 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:48:49.253+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:48:49.305+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:48:49.725+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880929:725112][1274:0x7f4ac5cbac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:48:49.725+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:48:49.745+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ac4bea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4AC4BC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF902FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4AC58A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4AC569D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4AC53A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4AC518E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4AC4F71000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4AC4BC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4AC5AAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ac4bea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:48:49.745+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:49:49.869+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:49:49.876+0000 I CONTROL [initandlisten] MongoDB starting : pid=1522 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:49:49.876+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:49:49.876+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:49:49.877+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:49:49.877+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:49:49.877+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:49:49.877+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:49:49.877+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:49:49.877+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:49:49.929+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:49:50.336+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507880990:336142][1522:0x7fc3ae306c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:49:50.336+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:49:50.355+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc3ad236635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC3AD215000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF65EBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3ADEED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3ADCE9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3AD9EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3AD7DA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3AD5BD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3AD215000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3AE0F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc3ad236635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:49:50.355+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:50:49.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=1738 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:50:49.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:50:49.551+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:50:49.954+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881049:954735][1738:0x7f2cc0315c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:50:49.954+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:50:49.974+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2cbf245635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2CBF224000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE50E0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2CBFEFC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2CBFCF8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2CBF9FE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2CBF7E9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2CBF5CC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2CBF224000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2CC0105000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2cbf245635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:50:49.974+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:51:49.443+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:51:49.450+0000 I CONTROL [initandlisten] MongoDB starting : pid=1990 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:51:49.450+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:51:49.450+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:51:49.451+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:51:49.451+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:51:49.451+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:51:49.451+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:51:49.451+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:51:49.451+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:51:49.500+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:51:49.862+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881109:862689][1990:0x7fa875789c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:51:49.862+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:51:49.873+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8746b9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA874698000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC81F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA875370000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA87516C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA874E72000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA874C5D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA874A40000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA874698000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA875579000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8746b9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:51:49.873+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:52:50.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] MongoDB starting : pid=2117 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:52:50.008+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:52:50.041+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:52:50.407+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881170:407385][2117:0x7fee751b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:52:50.407+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:52:50.426+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee740e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE740C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF022FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE74DA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE74B9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE748A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE7468D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE74470000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE740C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE74FA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee740e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:52:50.426+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:53:49.436+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=2386 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:53:49.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:53:49.444+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:53:49.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:53:49.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881229:846421][2386:0x7fef31f1ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:53:49.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:53:49.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef30e4a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF30E29000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF31B01000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF318FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF31603000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF313EE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF311D1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF30E29000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF31D0A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef30e4a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:53:49.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:54:49.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] MongoDB starting : pid=2635 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:54:50.005+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:54:50.006+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:54:50.056+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:54:50.486+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881290:486855][2635:0x7f6b987b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:54:50.486+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:54:50.507+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b976e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B976C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF791DD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B9839F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B9819B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B97EA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B97C8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B97A6F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B976C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B985A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b976e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:54:50.507+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:55:49.638+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] MongoDB starting : pid=2841 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:55:49.645+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:55:49.695+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:55:50.135+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881350:135206][2841:0x7ffba1366c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:55:50.135+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:55:50.155+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffba0296635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBA0275000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9565000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBA0F4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBA0D49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBA0A4F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBA083A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBA061D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBA0275000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBA1156000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffba0296635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:55:50.155+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:56:49.533+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] MongoDB starting : pid=3086 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:56:49.541+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:56:49.592+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:56:49.958+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881409:958361][3086:0x7fca13e0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:56:49.958+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:56:49.972+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca12d3a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA12D19000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE4CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA139F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA137ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA134F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA132DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA130C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA12D19000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA13BFA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca12d3a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:56:49.972+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:57:49.114+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] MongoDB starting : pid=3206 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:57:49.122+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:57:49.178+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:57:49.582+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881469:582727][3206:0x7fa6215e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:57:49.582+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:57:49.602+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa620519635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6204F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB92FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6211D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA620FCC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA620CD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA620ABD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6208A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6204F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6213D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa620519635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:57:49.602+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:58:49.737+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] MongoDB starting : pid=3503 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:58:49.744+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:58:49.795+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:58:50.119+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881530:119330][3503:0x7f5756468c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:58:50.119+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:58:50.140+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5755398635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5755377000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0435000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F575604F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5755E4B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5755B51000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F575593C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F575571F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5755377000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5756258000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5755398635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:58:50.140+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T07:59:49.758+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] MongoDB starting : pid=3736 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] modules: none 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] build environment: 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T07:59:49.766+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T07:59:49.817+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T07:59:50.212+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881590:212245][3736:0x7f01f0c76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T07:59:50.212+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T07:59:50.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f01efba6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F01EFB85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1133000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01F085D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01F0659000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01F035F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01F014A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01EFF2D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F01EFB85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F01F0A66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f01efba6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T07:59:50.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:00:49.358+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:00:49.365+0000 I CONTROL [initandlisten] MongoDB starting : pid=3961 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:00:49.366+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:00:49.415+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:00:49.791+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881649:791957][3961:0x7f41ad2e9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:00:49.792+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:00:49.812+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f41ac219635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F41AC1F8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF66AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F41ACED0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F41ACCCC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41AC9D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F41AC7BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F41AC5A0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F41AC1F8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41AD0D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f41ac219635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:00:49.812+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:01:49.253+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] MongoDB starting : pid=4204 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:01:49.261+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:01:49.311+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:01:49.766+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881709:766798][4204:0x7ffb0464cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:01:49.767+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:01:49.790+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb0357c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB0355B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB04233000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB0402F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB03D35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB03B20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB03903000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB0355B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB0443C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb0357c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:01:49.790+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:02:49.361+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] MongoDB starting : pid=4335 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:02:49.369+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:02:49.370+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:02:49.423+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:02:49.917+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881769:917188][4335:0x7f3906f31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:02:49.917+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:02:49.937+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3905e61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3905E40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF666FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3906B18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3906914000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F390661A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3906405000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39061E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3905E40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3906D21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3905e61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:02:49.937+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:03:49.063+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] MongoDB starting : pid=4619 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:03:49.070+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:03:49.120+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:03:49.496+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881829:496979][4619:0x7f90575d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:03:49.497+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:03:49.509+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9056507635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F90564E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9A1F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90571BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9056FBA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9056CC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9056AAB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F905688E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F90564E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90573C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9056507635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:03:49.509+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:04:49.158+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] MongoDB starting : pid=4822 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:04:49.166+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:04:49.216+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:04:49.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881889:643508][4822:0x7ffbc028ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:04:49.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:04:49.663+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffbbf1ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBBF199000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBBFE71000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBBFC6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBBF973000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBBF75E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBBF541000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBBF199000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBC007A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffbbf1ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:04:49.663+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:05:49.795+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] MongoDB starting : pid=5015 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:05:49.802+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:05:49.852+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:05:50.302+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507881950:302072][5015:0x7fc980e70c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:05:50.302+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:05:50.321+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc97fda0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC97FD7F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC980A57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC980853000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC980559000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC980344000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC980127000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC97FD7F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC980C60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc97fda0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:05:50.321+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:06:49.741+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] MongoDB starting : pid=5522 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:06:49.749+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:06:49.804+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:06:50.120+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882010:120835][5522:0x7fcfe5896c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:06:50.120+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:06:50.131+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcfe47c6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCFE47A5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFE547D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFE5279000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFE4F7F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFE4D6A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFE4B4D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCFE47A5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFE5686000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcfe47c6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:06:50.131+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:07:49.259+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] MongoDB starting : pid=5890 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:07:49.266+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:07:49.316+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:07:49.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882069:706982][5890:0x7fd2c2170c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:07:49.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:07:49.726+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd2c10a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD2C107F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3447000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2C1D57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2C1B53000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2C1859000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD2C1644000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD2C1427000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD2C107F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2C1F60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd2c10a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:07:49.726+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:08:49.853+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] MongoDB starting : pid=6110 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:08:49.860+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:08:49.861+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:08:49.861+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:08:49.913+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:08:50.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882130:242454][6110:0x7f5a9c6b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:08:50.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:08:50.253+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a9b5e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A9B5C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1E1B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A9C29F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A9C09B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A9BDA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A9BB8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A9B96F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A9B5C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A9C4A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a9b5e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:08:50.253+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:09:49.821+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] MongoDB starting : pid=6542 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:09:49.828+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:09:49.880+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:09:50.232+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882190:232146][6542:0x7f5cd09f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:09:50.232+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:09:50.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ccf926635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5CCF905000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03EF0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5CD05DD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5CD03D9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5CD00DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5CCFECA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5CCFCAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5CCF905000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5CD07E6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ccf926635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:09:50.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:10:49.379+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] MongoDB starting : pid=6787 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:10:49.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:10:49.436+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:10:49.866+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882249:866641][6787:0x7f0edc0b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:10:49.866+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:10:49.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0edafe3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0EDAFC2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE5AE5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0EDBC9A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0EDBA96000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0EDB79C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0EDB587000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0EDB36A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0EDAFC2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0EDBEA3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0edafe3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:10:49.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:11:49.346+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] MongoDB starting : pid=7032 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:11:49.354+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:11:49.406+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:11:49.733+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882309:733920][7032:0x7f8f3a424c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:11:49.733+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:11:49.745+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8f39354635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8F39333000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8F3A00B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8F39E07000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8F39B0D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8F398F8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8F396DB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8F39333000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8F3A214000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8f39354635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:11:49.745+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:12:49.870+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:12:49.877+0000 I CONTROL [initandlisten] MongoDB starting : pid=7313 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:12:49.878+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:12:49.928+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:12:50.328+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882370:328953][7313:0x7fa04dc2fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:12:50.329+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:12:50.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa04cb5f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA04CB3E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3269B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA04D816000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA04D612000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA04D318000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA04D103000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA04CEE6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA04CB3E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA04DA1F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa04cb5f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:12:50.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:13:49.483+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] MongoDB starting : pid=7463 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:13:49.490+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:13:49.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:13:49.866+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882429:866194][7463:0x7f54c4d6ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:13:49.866+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:13:49.876+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54c3c9a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54C3C79000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8685C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54C4951000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F54C474D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F54C4453000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F54C423E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F54C4021000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54C3C79000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54C4B5A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54c3c9a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:13:49.876+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:14:50.007+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:14:50.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=7808 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:14:50.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:14:50.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:14:50.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:14:50.015+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:14:50.015+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:14:50.016+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:14:50.016+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:14:50.016+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:14:50.067+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:14:50.449+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882490:449716][7808:0x7fc7fc72ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:14:50.449+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:14:50.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7fb65e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7FB63D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB61A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7FC315000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7FC111000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7FBE17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7FBC02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7FB9E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7FB63D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7FC51E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7fb65e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:14:50.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:15:49.598+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] MongoDB starting : pid=8017 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:15:49.605+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:15:49.654+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:15:50.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882550:62002][8017:0x7fa6c341fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:15:50.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:15:50.081+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6c234f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6C232E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6C3006000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6C2E02000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6C2B08000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6C28F3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6C26D6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6C232E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6C320F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6c234f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:15:50.081+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:16:49.515+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:16:49.522+0000 I CONTROL [initandlisten] MongoDB starting : pid=8271 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:16:49.522+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:16:49.522+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:16:49.522+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:16:49.523+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:16:49.523+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:16:49.523+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:16:49.523+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:16:49.523+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:16:49.573+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:16:49.948+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882609:948801][8271:0x7f0709354c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:16:49.948+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:16:49.968+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0708284635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0708263000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF720FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0708F3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0708D37000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0708A3D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0708828000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F070860B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0708263000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0709144000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0708284635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:16:49.968+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:17:49.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=8473 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:17:49.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:17:49.154+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:17:49.499+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882669:499640][8473:0x7f3dab943c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:17:49.499+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:17:49.511+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3daa873635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DAA852000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1F099000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DAB52A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DAB326000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DAB02C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DAAE17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DAABFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DAA852000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DAB733000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3daa873635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:17:49.511+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:18:49.631+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] MongoDB starting : pid=8634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:18:49.638+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:18:49.688+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:18:50.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882730:50956][8634:0x7fd7a417ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:18:50.051+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:18:50.061+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7a30ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7A308D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7A3D65000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7A3B61000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7A3867000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7A3652000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7A3435000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7A308D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7A3F6E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7a30ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:18:50.061+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:19:49.372+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] MongoDB starting : pid=8912 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:19:49.379+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:19:49.429+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:19:49.808+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882789:808237][8912:0x7f880605ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:19:49.808+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:19:49.827+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8804f8e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8804F6D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6F6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8805C45000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8805A41000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8805747000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8805532000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8805315000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8804F6D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8805E4E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8804f8e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:19:49.827+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:20:49.957+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] MongoDB starting : pid=9127 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:20:49.964+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:20:50.013+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:20:50.375+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882850:375355][9127:0x7f6791806c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:20:50.375+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:20:50.394+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6790736635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6790715000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD46FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67913ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67911E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6790EEF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6790CDA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6790ABD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6790715000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67915F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6790736635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:20:50.394+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:21:49.790+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] MongoDB starting : pid=9374 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:21:49.797+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:21:49.847+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:21:50.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882910:261326][9374:0x7fd2c6b80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:21:50.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:21:50.281+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd2c5ab0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD2C5A8F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2C6767000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2C6563000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2C6269000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD2C6054000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD2C5E37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD2C5A8F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2C6970000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd2c5ab0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:21:50.281+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:22:49.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:22:49.413+0000 I CONTROL [initandlisten] MongoDB starting : pid=9577 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:22:49.413+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:22:49.414+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:22:49.465+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:22:49.841+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507882969:841826][9577:0x7f4d43843c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:22:49.841+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:22:49.858+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d42773635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D42752000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B2A8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D4342A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D43226000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D42F2C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D42D17000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D42AFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D42752000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D43633000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d42773635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:22:49.858+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:23:49.991+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] MongoDB starting : pid=9723 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:23:49.998+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:23:50.047+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:23:50.467+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883030:467111][9723:0x7f21da4efc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:23:50.467+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:23:50.486+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f21d941f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F21D93FE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21DA0D6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21D9ED2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F21D9BD8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F21D99C3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21D97A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F21D93FE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21DA2DF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f21d941f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:23:50.486+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:24:49.809+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] MongoDB starting : pid=10008 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:24:49.817+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:24:49.867+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:24:50.226+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883090:226592][10008:0x7f543ba80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:24:50.226+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:24:50.237+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f543a9b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F543A98F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F543B667000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F543B463000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F543B169000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F543AF54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F543AD37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F543A98F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F543B870000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f543a9b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:24:50.237+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:25:49.363+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] MongoDB starting : pid=10223 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:25:49.371+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:25:49.422+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:25:49.771+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883149:771740][10223:0x7f8a99065c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:25:49.771+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:25:49.782+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8a97f95635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8A97F74000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB27CF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8A98C4C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8A98A48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8A9874E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8A98539000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8A9831C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8A97F74000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8A98E55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8a97f95635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:25:49.782+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:26:49.186+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:26:49.192+0000 I CONTROL [initandlisten] MongoDB starting : pid=10485 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:26:49.193+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:26:49.244+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:26:49.641+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883209:641753][10485:0x7fc13149cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:26:49.641+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:26:49.652+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1303cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1303AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF50480000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC131083000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC130E7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC130B85000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC130970000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC130753000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1303AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC13128C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1303cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:26:49.652+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:27:49.788+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:27:49.795+0000 I CONTROL [initandlisten] MongoDB starting : pid=10698 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:27:49.795+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:27:49.795+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:27:49.796+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:27:49.796+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:27:49.796+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:27:49.796+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:27:49.796+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:27:49.796+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:27:49.847+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:27:50.259+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883270:259227][10698:0x7f47b4719c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:27:50.259+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:27:50.279+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f47b3649635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F47B3628000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF62A73000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F47B4300000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F47B40FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F47B3E02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F47B3BED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F47B39D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F47B3628000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F47B4509000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f47b3649635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:27:50.279+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:28:49.413+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] MongoDB starting : pid=10850 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:28:49.421+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:28:49.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:28:49.886+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883329:886330][10850:0x7fa7eac5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:28:49.886+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:28:49.905+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7e9b8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7E9B6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF832FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7EA844000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7EA640000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7EA346000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7EA131000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7E9F14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7E9B6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7EAA4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7e9b8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:28:49.905+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:29:49.077+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] MongoDB starting : pid=11139 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:29:49.085+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:29:49.139+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:29:49.426+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883389:426931][11139:0x7f4c74288c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:29:49.426+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:29:49.437+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4c731b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4C73197000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF182FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4C73E6F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4C73C6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4C73971000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4C7375C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4C7353F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4C73197000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4C74078000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4c731b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:29:49.437+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:30:49.562+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] MongoDB starting : pid=11353 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:30:49.569+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:30:49.642+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:30:49.981+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883449:981138][11353:0x7f19f7e7bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:30:49.981+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:30:49.994+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19f6dab635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19F6D8A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19F7A62000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19F785E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19F7564000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19F734F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19F7132000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19F6D8A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19F7C6B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19f6dab635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:30:49.994+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:31:49.463+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=11597 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:31:49.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:31:49.520+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:31:49.900+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883509:900406][11597:0x7f59f8bf4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:31:49.900+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:31:49.913+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59f7b24635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F59F7B03000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F59F87DB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F59F85D7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F59F82DD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F59F80C8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F59F7EAB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F59F7B03000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F59F89E4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59f7b24635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:31:49.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:32:50.038+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:32:50.045+0000 I CONTROL [initandlisten] MongoDB starting : pid=11803 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:32:50.045+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:32:50.045+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:32:50.045+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:32:50.046+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:32:50.046+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:32:50.046+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:32:50.046+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:32:50.046+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:32:50.095+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:32:50.508+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883570:508102][11803:0x7f7d09f56c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:32:50.508+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:32:50.527+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7d08e86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7D08E65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0CEF6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7D09B3D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7D09939000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7D0963F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7D0942A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7D0920D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7D08E65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7D09D46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7d08e86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:32:50.527+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:33:49.661+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] MongoDB starting : pid=11947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:33:49.671+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:33:49.734+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:33:50.117+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883630:117069][11947:0x7f8bb8a1dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:33:50.117+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:33:50.136+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8bb794d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BB792C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF796FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BB8604000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BB8400000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BB8106000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BB7EF1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BB7CD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BB792C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BB880D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8bb794d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:33:50.136+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:34:49.324+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=12228 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:34:49.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:34:49.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:34:49.836+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883689:836577][12228:0x7f2164f3dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:34:49.836+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:34:49.856+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2163e6d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2163E4C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB67AB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2164B24000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2164920000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2164626000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2164411000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F21641F4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2163E4C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2164D2D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2163e6d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:34:49.856+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:35:49.978+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] MongoDB starting : pid=12443 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:35:49.986+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:35:50.041+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:35:50.387+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883750:387056][12443:0x7f4ba661cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:35:50.387+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:35:50.399+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ba554c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4BA552B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4BA6203000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4BA5FFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4BA5D05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4BA5AF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4BA58D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4BA552B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4BA640C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ba554c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:35:50.399+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:36:49.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=12695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:36:49.809+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:36:49.862+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:36:50.300+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883810:300466][12695:0x7ff0c7291c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:36:50.300+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:36:50.320+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff0c61c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0C61A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17B3A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF0C6E78000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF0C6C74000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF0C697A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF0C6765000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF0C6548000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0C61A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF0C7081000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff0c61c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:36:50.320+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:37:49.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] MongoDB starting : pid=12892 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:37:49.457+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:37:49.508+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:37:49.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883869:964801][12892:0x7f5c73f25c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:37:49.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:37:49.985+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5c72e55635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5C72E34000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF553BF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5C73B0C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5C73908000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5C7360E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5C733F9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5C731DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5C72E34000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5C73D15000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5c72e55635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:37:49.985+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:38:49.116+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=13036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:38:49.123+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:38:49.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:38:49.529+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883929:529546][13036:0x7f37a1fa2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:38:49.529+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:38:49.540+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37a0ed2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37A0EB1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAECD3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37A1B89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37A1985000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F37A168B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37A1476000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F37A1259000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37A0EB1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F37A1D92000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37a0ed2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:38:49.540+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:39:49.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] MongoDB starting : pid=13287 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:39:49.505+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:39:49.554+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:39:49.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507883989:933868][13287:0x7fcb0074ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:39:49.933+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:39:49.946+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcaff67e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCAFF65D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCB00335000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCB00131000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCAFFE37000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCAFFC22000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCAFFA05000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCAFF65D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCB0053E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcaff67e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:39:49.946+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:40:49.067+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=13440 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:40:49.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:40:49.124+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:40:49.546+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884049:546079][13440:0x7ff1bfa94c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:40:49.546+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:40:49.565+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1be9c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1BE9A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF07201000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF1BF67B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF1BF477000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF1BF17D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1BEF68000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1BED4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1BE9A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1BF884000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1be9c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:40:49.565+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:41:50.019+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] MongoDB starting : pid=13698 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:41:50.027+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:41:50.079+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:41:50.462+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884110:462096][13698:0x7ff069ef7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:41:50.462+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:41:50.481+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff068e27635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF068E06000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF069ADE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF0698DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF0695E0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF0693CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF0691AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF068E06000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF069CE7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff068e27635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:41:50.481+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:42:49.609+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] MongoDB starting : pid=13900 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:42:49.616+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:42:49.665+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:42:50.032+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884170:32951][13900:0x7fd7dcbf7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:42:50.033+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:42:50.052+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7dbb27635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7DBB06000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE835000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7DC7DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7DC5DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7DC2E0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7DC0CB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7DBEAE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7DBB06000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7DC9E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7dbb27635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:42:50.052+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:43:49.176+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] MongoDB starting : pid=14132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:43:49.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:43:49.234+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:43:49.655+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884229:655005][14132:0x7f250deffc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:43:49.655+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:43:49.677+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f250ce2f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F250CE0E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF027E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F250DAE6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F250D8E2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F250D5E8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F250D3D3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F250D1B6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F250CE0E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F250DCEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f250ce2f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:43:49.677+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:44:49.698+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:44:49.706+0000 I CONTROL [initandlisten] MongoDB starting : pid=14284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:44:49.706+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:44:49.707+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:44:49.757+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:44:50.085+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884290:85958][14284:0x7f1f9b1ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:44:50.086+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:44:50.097+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f9a11c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F9A0FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD74FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F9ADD3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F9ABCF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F9A8D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F9A6C0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F9A4A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F9A0FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F9AFDC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f9a11c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:44:50.097+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:45:49.220+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] MongoDB starting : pid=14874 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:45:49.227+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:45:49.277+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:45:49.683+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884349:683472][14874:0x7f619554ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:45:49.683+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:45:49.694+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f619447a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6194459000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF132FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6195131000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6194F2D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6194C33000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6194A1E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6194801000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6194459000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F619533A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f619447a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:45:49.694+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:46:49.086+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=15156 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:46:49.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:46:49.147+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:46:49.506+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884409:506228][15156:0x7f33734d9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:46:49.506+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:46:49.525+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3372409635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33723E8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF158FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33730C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3372EBC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3372BC2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33729AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3372790000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33723E8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33732C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3372409635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:46:49.525+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:47:49.661+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] MongoDB starting : pid=15361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:47:49.668+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:47:49.719+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:47:50.152+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884470:152277][15361:0x7ff3b9c81c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:47:50.152+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:47:50.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff3b8bb1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF3B8B90000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF92B0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF3B9868000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3B9664000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3B936A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3B9155000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3B8F38000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3B8B90000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3B9A71000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff3b8bb1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:47:50.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:48:49.295+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:48:49.303+0000 I CONTROL [initandlisten] MongoDB starting : pid=15600 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:48:49.303+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:48:49.303+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:48:49.303+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:48:49.304+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:48:49.304+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:48:49.304+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:48:49.304+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:48:49.304+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:48:49.356+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:48:49.906+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884529:906675][15600:0x7fe7cc7fec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:48:49.906+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:48:49.925+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe7cb72e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE7CB70D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7CC3E5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7CC1E1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7CBEE7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE7CBCD2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE7CBAB5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE7CB70D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7CC5EE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe7cb72e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:48:49.925+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:49:49.212+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] MongoDB starting : pid=15744 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:49:49.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:49:49.270+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:49:49.667+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884589:667618][15744:0x7fe1732f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:49:49.667+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:49:49.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe172222635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE172201000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE172ED9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE172CD5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1729DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1727C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1725A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE172201000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1730E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe172222635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:49:49.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:50:49.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] MongoDB starting : pid=16011 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:50:49.822+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:50:49.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:50:50.312+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884650:312389][16011:0x7f2ef2a83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:50:50.312+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:50:50.332+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2ef19b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2EF1992000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB1EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2EF266A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2EF2466000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2EF216C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2EF1F57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2EF1D3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2EF1992000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2EF2873000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2ef19b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:50:50.332+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:51:49.716+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=16260 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:51:49.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:51:49.775+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:51:50.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884710:153632][16260:0x7f181ca6fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:51:50.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:51:50.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f181b99f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F181B97E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFEAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F181C656000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F181C452000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F181C158000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F181BF43000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F181BD26000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F181B97E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F181C85F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f181b99f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:51:50.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:52:49.312+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] MongoDB starting : pid=16471 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:52:49.320+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:52:49.374+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:52:49.814+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884769:814557][16471:0x7f01149edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:52:49.814+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:52:49.834+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f011391d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F01138FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01145D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01143D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01140D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0113EC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0113CA4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F01138FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F01147DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f011391d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:52:49.834+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:53:49.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] MongoDB starting : pid=16701 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:53:49.977+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:53:50.027+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:53:50.455+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884830:455747][16701:0x7ff9dd9a4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:53:50.455+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:53:50.477+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9dc8d4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9DC8B3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E0E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF9DD58B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9DD387000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9DD08D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9DCE78000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF9DCC5B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9DC8B3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9DD794000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9dc8d4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:53:50.477+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:54:49.955+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] MongoDB starting : pid=16850 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:54:49.963+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:54:50.013+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:54:50.415+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884890:415242][16850:0x7f2b0a255c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:54:50.415+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:54:50.435+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2b09185635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2B09164000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2B09E3C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2B09C38000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2B0993E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2B09729000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2B0950C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2B09164000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2B0A045000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2b09185635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:54:50.435+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:55:49.563+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:55:49.570+0000 I CONTROL [initandlisten] MongoDB starting : pid=17110 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:55:49.570+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:55:49.571+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:55:49.620+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:55:50.031+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507884950:31210][17110:0x7f96c78ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:55:50.031+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:55:50.051+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96c681b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96C67FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF748FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96C74D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96C72CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96C6FD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96C6DBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96C6BA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96C67FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96C76DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96c681b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:55:50.051+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:56:49.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=17367 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:56:49.477+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:56:49.528+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:56:49.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885009:963014][17367:0x7fa5d0152c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:56:49.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:56:49.973+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5cf082635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5CF061000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAEEA4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5CFD39000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5CFB35000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5CF83B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5CF626000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5CF409000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5CF061000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5CFF42000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5cf082635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:56:49.973+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:57:49.106+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] MongoDB starting : pid=17570 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:57:49.115+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:57:49.179+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:57:49.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885069:559550][17570:0x7f9e28d10c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:57:49.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:57:49.571+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e27c40635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E27C1F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF208FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E288F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E286F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E283F9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E281E4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E27FC7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E27C1F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E28B00000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e27c40635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:57:49.571+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:58:49.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] MongoDB starting : pid=17812 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:58:49.706+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:58:49.756+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:58:50.175+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885130:175027][17812:0x7fc338053c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:58:50.175+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:58:50.194+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc336f83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC336F62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC337C3A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC337A36000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC33773C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC337527000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC33730A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC336F62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC337E43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc336f83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:58:50.194+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T08:59:49.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] MongoDB starting : pid=17958 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] modules: none 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] build environment: 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T08:59:49.097+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T08:59:49.147+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T08:59:49.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885189:561337][17958:0x7f35e6390c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T08:59:49.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T08:59:49.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f35e52c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F35E529F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF96AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F35E5F77000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F35E5D73000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F35E5A79000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F35E5864000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F35E5647000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F35E529F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F35E6180000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f35e52c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T08:59:49.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:00:49.705+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:00:49.712+0000 I CONTROL [initandlisten] MongoDB starting : pid=18221 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:00:49.713+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:00:49.763+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:00:50.162+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885250:162837][18221:0x7f45abe2dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:00:50.162+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:00:50.182+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45aad5d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45AAD3C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF616FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45ABA14000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45AB810000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45AB516000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F45AB301000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F45AB0E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45AAD3C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45ABC1D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45aad5d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:00:50.183+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:01:49.584+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] MongoDB starting : pid=18476 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:01:49.592+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:01:49.643+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:01:50.023+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885310:23310][18476:0x7f1556965c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:01:50.023+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:01:50.040+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1555895635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1555874000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F3E9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F155654C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1556348000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F155604E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1555E39000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1555C1C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1555874000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1556755000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1555895635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:01:50.040+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:02:49.639+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] MongoDB starting : pid=18690 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:02:49.646+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:02:49.703+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:02:50.070+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885370:70792][18690:0x7ffd9814dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:02:50.070+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:02:50.084+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd9707d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD9705C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD97D34000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD97B30000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD97836000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD97621000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD97404000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD9705C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD97F3D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd9707d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:02:50.084+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:03:49.209+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] MongoDB starting : pid=18918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:03:49.217+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:03:49.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:03:49.627+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885429:627008][18918:0x7f95032dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:03:49.627+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:03:49.638+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f950220f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F95021EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31E62000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9502EC6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9502CC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F95029C8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F95027B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9502596000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F95021EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F95030CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f950220f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:03:49.638+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:04:49.647+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=19071 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:04:49.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:04:49.704+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:04:50.054+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885490:54665][19071:0x7ffc5536bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:04:50.054+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:04:50.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc5429b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC5427A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB7AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC54F52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC54D4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC54A54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC5483F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC54622000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC5427A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC5515B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc5429b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:04:50.066+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:05:49.182+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:05:49.189+0000 I CONTROL [initandlisten] MongoDB starting : pid=19339 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:05:49.189+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:05:49.190+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:05:49.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:05:49.612+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885549:612674][19339:0x7f7f27c19c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:05:49.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:05:49.632+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f26b49635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F26B28000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03DF1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F27800000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F275FC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F27302000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F270ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F26ED0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F26B28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F27A09000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f26b49635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:05:49.632+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:06:49.058+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] MongoDB starting : pid=19588 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:06:49.065+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:06:49.115+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:06:49.425+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885609:425459][19588:0x7f0f6dfcbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:06:49.425+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:06:49.436+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0f6cefb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0F6CEDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF340FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0F6DBB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0F6D9AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0F6D6B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0F6D49F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0F6D282000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0F6CEDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0F6DDBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0f6cefb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:06:49.436+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:07:49.562+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] MongoDB starting : pid=19788 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:07:49.570+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:07:49.621+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:07:50.058+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885670:58343][19788:0x7f4136c7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:07:50.058+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:07:50.078+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4135bad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4135B8C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCFAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4136864000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4136660000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4136366000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4136151000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4135F34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4135B8C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4136A6D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4135bad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:07:50.078+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:08:49.191+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] MongoDB starting : pid=20024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:08:49.195+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:08:49.230+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:08:49.573+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885729:573278][20024:0x7fba46e2cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:08:49.573+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:08:49.583+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba45d5c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA45D3B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF80EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA46A13000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA4680F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA46515000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA46300000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA460E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA45D3B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA46C1C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba45d5c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:08:49.583+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:09:49.928+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] MongoDB starting : pid=20167 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:09:49.935+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:09:49.988+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:09:50.283+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885790:283182][20167:0x7feba4fcbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:09:50.283+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:09:50.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7feba3efb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEBA3EDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEBA4BB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEBA49AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEBA46B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEBA449F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEBA4282000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEBA3EDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEBA4DBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7feba3efb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:09:50.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:10:49.422+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] MongoDB starting : pid=20432 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:10:49.430+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:10:49.481+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:10:49.834+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885849:834108][20432:0x7f16d6714c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:10:49.834+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:10:49.844+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16d5644635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16D5623000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF13CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F16D62FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F16D60F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F16D5DFD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F16D5BE8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F16D59CB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16D5623000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F16D6504000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16d5644635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:10:49.844+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:11:49.231+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] MongoDB starting : pid=20682 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:11:49.239+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:11:49.289+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:11:49.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885909:662211][20682:0x7fdabf39cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:11:49.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:11:49.682+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdabe2cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDABE2AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE64FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDABEF83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDABED7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDABEA85000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDABE870000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDABE653000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDABE2AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDABF18C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdabe2cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:11:49.682+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:12:49.815+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] MongoDB starting : pid=20920 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:12:49.822+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:12:49.872+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:12:50.222+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507885970:222213][20920:0x7fba17ef1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:12:50.222+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:12:50.241+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba16e21635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA16E00000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF77AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA17AD8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA178D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA175DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA173C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA171A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA16E00000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA17CE1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba16e21635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:12:50.241+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:13:49.379+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:13:49.386+0000 I CONTROL [initandlisten] MongoDB starting : pid=21160 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:13:49.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:13:49.437+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:13:49.837+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886029:837801][21160:0x7f3b10226c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:13:49.837+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:13:49.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3b0f156635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3B0F135000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3B0FE0D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3B0FC09000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3B0F90F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3B0F6FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3B0F4DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3B0F135000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3B10016000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3b0f156635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:13:49.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:14:49.128+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] MongoDB starting : pid=21294 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:14:49.136+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:14:49.187+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:14:49.572+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886089:572811][21294:0x7f4e8c05bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:14:49.572+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:14:49.592+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e8af8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E8AF6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6EEF5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E8BC42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E8BA3E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E8B744000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E8B52F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E8B312000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E8AF6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E8BE4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e8af8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:14:49.592+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:15:49.715+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=21474 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:15:49.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:15:49.775+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:15:50.157+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886150:157695][21474:0x7f0a5f953c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:15:50.157+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:15:50.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a5e883635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A5E862000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A5F53A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A5F336000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A5F03C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A5EE27000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A5EC0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A5E862000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A5F743000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a5e883635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:15:50.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:16:49.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] MongoDB starting : pid=21720 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:16:49.581+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:16:49.632+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:16:49.965+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886209:965497][21720:0x7f478dc31c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:16:49.965+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:16:49.976+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f478cb61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F478CB40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF702FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F478D818000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F478D614000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F478D31A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F478D105000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F478CEE8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F478CB40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F478DA21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f478cb61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:16:49.976+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:17:49.090+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] MongoDB starting : pid=21927 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:17:49.097+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:17:49.146+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:17:49.557+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886269:557498][21927:0x7f234f167c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:17:49.557+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:17:49.576+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f234e097635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F234E076000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF812FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F234ED4E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F234EB4A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F234E850000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F234E63B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F234E41E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F234E076000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F234EF57000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f234e097635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:17:49.576+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:18:49.710+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] MongoDB starting : pid=22168 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:18:49.717+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:18:49.767+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:18:50.198+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886330:198053][22168:0x7f287d7a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:18:50.198+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:18:50.217+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f287c6d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F287C6B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F287D390000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F287D18C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F287CE92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F287CC7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F287CA60000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F287C6B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F287D599000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f287c6d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:18:50.217+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:19:49.268+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] MongoDB starting : pid=22375 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:19:49.275+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:19:49.326+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:19:49.722+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886389:722025][22375:0x7f015271cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:19:49.722+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:19:49.741+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f015164c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F015162B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0152303000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01520FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0151E05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0151BF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01519D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F015162B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F015250C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f015164c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:19:49.741+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:20:49.863+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] MongoDB starting : pid=22522 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:20:49.870+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:20:49.920+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:20:50.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886450:291632][22522:0x7f15df3cac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:20:50.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:20:50.308+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f15de2fa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F15DE2D9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF651DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F15DEFB1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F15DEDAD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F15DEAB3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F15DE89E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F15DE681000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F15DE2D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F15DF1BA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f15de2fa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:20:50.308+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:21:49.761+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] MongoDB starting : pid=22813 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:21:49.768+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:21:49.818+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:21:50.211+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886510:211766][22813:0x7f99ab581c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:21:50.211+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:21:50.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99aa4b1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99AA490000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF134FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99AB168000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99AAF64000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99AAC6A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99AAA55000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99AA838000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99AA490000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99AB371000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99aa4b1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:21:50.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:22:49.359+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] MongoDB starting : pid=23024 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:22:49.367+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:22:49.417+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:22:49.842+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886569:842426][23024:0x7f86d976bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:22:49.842+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:22:49.861+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86d869b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86D867A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF48AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86D9352000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86D914E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86D8E54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86D8C3F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86D8A22000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86D867A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86D955B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86d869b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:22:49.861+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:23:49.987+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] MongoDB starting : pid=23251 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:23:49.994+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:23:50.047+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:23:50.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886630:490619][23251:0x7ff65fc98c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:23:50.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:23:50.510+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff65ebc8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF65EBA7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB9EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF65F87F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF65F67B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF65F381000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF65F16C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF65EF4F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF65EBA7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF65FA88000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff65ebc8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:23:50.510+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:24:49.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=23452 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:24:49.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:24:49.860+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:24:50.261+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886690:261796][23452:0x7fdedf48dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:24:50.261+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:24:50.281+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdede3bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDEDE39C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF216FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDEDF074000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDEDEE70000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDEDEB76000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDEDE961000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDEDE744000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDEDE39C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDEDF27D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdede3bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:24:50.281+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:25:49.418+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] MongoDB starting : pid=23602 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:25:49.425+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:25:49.475+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:25:49.836+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886749:836301][23602:0x7f73cf286c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:25:49.836+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:25:49.849+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f73ce1b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F73CE195000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF804FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F73CEE6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F73CEC69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F73CE96F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73CE75A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73CE53D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F73CE195000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F73CF076000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f73ce1b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:25:49.849+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:26:49.239+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] MongoDB starting : pid=23901 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:26:49.247+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:26:49.248+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:26:49.248+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:26:49.303+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:26:49.726+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886809:726577][23901:0x7faa082a5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:26:49.726+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:26:49.737+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa071d5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA071B4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B22F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA07E8C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA07C88000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA0798E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA07779000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA0755C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA071B4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA08095000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa071d5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:26:49.737+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:27:49.858+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] MongoDB starting : pid=24110 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:27:49.865+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:27:49.916+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:27:50.201+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886870:201399][24110:0x7fe458726c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:27:50.201+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:27:50.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe457656635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE457635000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26250000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE45830D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE458109000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE457E0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE457BFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4579DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE457635000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE458516000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe457656635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:27:50.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:28:49.325+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] MongoDB starting : pid=24343 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:28:49.332+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:28:49.382+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:28:49.690+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886929:690596][24343:0x7ff2e7591c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:28:49.690+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:28:49.705+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff2e64c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF2E64A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3889B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF2E7178000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF2E6F74000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2E6C7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF2E6A65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF2E6848000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF2E64A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF2E7381000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff2e64c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:28:49.705+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:29:49.820+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=24543 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:29:49.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:29:49.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:29:50.169+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507886990:169529][24543:0x7ffa95f50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:29:50.169+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:29:50.184+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa94e80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA94E5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF19881000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA95B37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA95933000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA95639000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA95424000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA95207000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA94E5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA95D40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa94e80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:29:50.184+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:30:49.416+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:30:49.423+0000 I CONTROL [initandlisten] MongoDB starting : pid=24686 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:30:49.424+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:30:49.474+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:30:49.833+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887049:833032][24686:0x7f6c169e1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:30:49.833+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:30:49.846+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6c15911635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6C158F0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4B48E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C165C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C163C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C160CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C15EB5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6C15C98000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6C158F0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C167D1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6c15911635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:30:49.846+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:31:49.228+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] MongoDB starting : pid=24993 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:31:49.235+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:31:49.285+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:31:49.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887109:559033][24993:0x7f22898c5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:31:49.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:31:49.572+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f22887f5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F22887D4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18EEE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22894AC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F22892A8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2288FAE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2288D99000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2288B7C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F22887D4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F22896B5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f22887f5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:31:49.572+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:32:49.703+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] MongoDB starting : pid=25209 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:32:49.711+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:32:49.762+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:32:50.081+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887170:81126][25209:0x7fe571985c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:32:50.081+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:32:50.091+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe5708b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE570894000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF77EFC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE57156C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE571368000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE57106E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE570E59000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE570C3C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE570894000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE571775000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe5708b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:32:50.091+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:33:49.227+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] MongoDB starting : pid=25437 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:33:49.234+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:33:49.285+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:33:49.614+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887229:614511][25437:0x7f27643b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:33:49.614+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:33:49.633+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27632e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F27632C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2763F9B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2763D97000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2763A9D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2763888000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F276366B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F27632C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27641A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27632e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:33:49.633+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:34:49.750+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] MongoDB starting : pid=25642 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:34:49.759+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:34:49.813+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:34:50.211+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887290:211246][25642:0x7fc4628cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:34:50.211+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:34:50.230+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4617ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4617DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF178FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4624B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4622B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC461FB8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC461DA3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC461B86000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4617DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4626BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4617ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:34:50.230+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:35:49.313+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] MongoDB starting : pid=25787 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:35:49.321+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:35:49.374+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:35:49.788+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887349:788155][25787:0x7f40c2910c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:35:49.788+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:35:49.808+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40c1840635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40C181F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40C24F7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40C22F3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40C1FF9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40C1DE4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40C1BC7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40C181F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40C2700000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40c1840635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:35:49.808+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:36:49.234+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] MongoDB starting : pid=26087 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:36:49.241+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:36:49.293+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:36:49.662+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887409:662684][26087:0x7f164eb9bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:36:49.662+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:36:49.682+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f164dacb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F164DAAA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF02E0A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F164E782000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F164E57E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F164E284000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F164E06F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F164DE52000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F164DAAA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F164E98B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f164dacb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:36:49.682+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:37:49.794+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] MongoDB starting : pid=26307 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:37:49.801+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:37:49.851+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:37:50.259+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887470:258997][26307:0x7f5032fdbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:37:50.259+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:37:50.270+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5031f0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5031EEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F07A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5032BC2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F50329BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F50326C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F50324AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5032292000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5031EEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5032DCB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5031f0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:37:50.270+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:38:49.394+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] MongoDB starting : pid=26532 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:38:49.403+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:38:49.453+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:38:49.818+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887529:818334][26532:0x7f44d5db1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:38:49.818+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:38:49.838+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f44d4ce1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F44D4CC0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF128FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F44D5998000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F44D5794000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F44D549A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F44D5285000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F44D5068000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F44D4CC0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F44D5BA1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f44d4ce1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:38:49.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:39:49.970+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] MongoDB starting : pid=26736 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:39:49.978+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:39:50.028+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:39:50.389+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887590:389163][26736:0x7f321a770c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:39:50.389+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:39:50.408+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32196a0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F321967F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAB8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F321A357000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F321A153000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3219E59000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3219C44000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3219A27000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F321967F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F321A560000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32196a0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:39:50.408+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:40:49.572+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] MongoDB starting : pid=26885 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:40:49.580+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:40:49.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:40:49.983+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887649:983218][26885:0x7f809bb42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:40:49.983+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:40:50.003+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f809aa72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F809AA51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF890FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F809B729000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F809B525000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F809B22B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F809B016000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F809ADF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F809AA51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F809B932000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f809aa72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:40:50.003+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:41:49.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=27171 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:41:49.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:41:49.493+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:41:49.918+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887709:918074][27171:0x7f99d2860c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:41:49.918+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:41:49.937+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f99d1790635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F99D176F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0F4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F99D2447000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99D2243000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99D1F49000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99D1D34000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99D1B17000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99D176F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99D2650000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f99d1790635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:41:49.937+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:42:49.059+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=27408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:42:49.066+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:42:49.118+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:42:49.471+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887769:471571][27408:0x7f968378fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:42:49.471+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:42:49.483+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96826bf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F968269E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD1CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9683376000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9683172000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9682E78000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9682C63000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9682A46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F968269E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F968357F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96826bf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:42:49.483+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:43:49.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] MongoDB starting : pid=27650 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:43:49.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:43:49.673+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:43:50.045+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887830:45462][27650:0x7face3a01c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:43:50.045+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:43:50.056+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7face2931635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FACE2910000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9308B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FACE35E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FACE33E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FACE30EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FACE2ED5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FACE2CB8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FACE2910000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FACE37F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7face2931635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:43:50.056+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:44:49.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:44:49.182+0000 I CONTROL [initandlisten] MongoDB starting : pid=27859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:44:49.182+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:44:49.183+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:44:49.233+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:44:49.596+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887889:596284][27859:0x7f9421000c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:44:49.596+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:44:49.620+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f941ff30635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F941FF0F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9420BE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F94209E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F94206E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F94204D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F94202B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F941FF0F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9420DF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f941ff30635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:44:49.621+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:45:49.159+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:45:49.166+0000 I CONTROL [initandlisten] MongoDB starting : pid=28003 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:45:49.166+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:45:49.166+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:45:49.166+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:45:49.166+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:45:49.166+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:45:49.167+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:45:49.167+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:45:49.167+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:45:49.217+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:45:49.608+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507887949:608631][28003:0x7f117b254c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:45:49.608+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:45:49.627+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f117a184635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F117A163000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF87C95000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F117AE3B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F117AC37000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F117A93D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F117A728000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F117A50B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F117A163000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F117B044000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f117a184635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:45:49.628+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:46:49.065+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:46:49.073+0000 I CONTROL [initandlisten] MongoDB starting : pid=28283 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:46:49.073+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:46:49.073+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:46:49.073+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:46:49.074+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:46:49.074+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:46:49.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:46:49.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:46:49.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:46:49.124+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:46:49.474+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888009:474637][28283:0x7fe042642c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:46:49.474+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:46:49.487+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe041572635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE041551000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF566FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE042229000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE042025000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE041D2B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE041B16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE0418F9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE041551000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE042432000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe041572635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:46:49.487+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:47:49.619+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] MongoDB starting : pid=28511 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:47:49.626+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:47:49.676+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:47:50.099+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888070:99963][28511:0x7f0c9d4cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:47:50.100+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:47:50.119+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0c9c3fd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0C9C3DC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF665E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0C9D0B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0C9CEB0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0C9CBB6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0C9C9A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0C9C784000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0C9C3DC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0C9D2BD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0c9c3fd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:47:50.119+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:48:49.238+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] MongoDB starting : pid=28739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:48:49.245+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:48:49.294+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:48:49.717+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888129:717536][28739:0x7f6f5543ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:48:49.717+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:48:49.736+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f5436a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F54349000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF60AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F55021000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F54E1D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F54B23000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F5490E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F546F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F54349000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F5522A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f5436a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:48:49.736+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:49:49.868+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] MongoDB starting : pid=28939 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:49:49.876+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:49:49.927+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:49:50.317+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888190:317799][28939:0x7f63f78edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:49:50.317+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:49:50.337+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f63f681d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F63F67FC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40C88000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F63F74D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F63F72D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F63F6FD6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F63F6DC1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F63F6BA4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F63F67FC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F63F76DD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f63f681d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:49:50.337+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:50:49.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] MongoDB starting : pid=29075 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:50:49.385+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:50:49.435+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:50:49.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888249:784563][29075:0x7f147d72ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:50:49.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:50:49.804+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f147c65e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F147C63D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF11A60000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F147D315000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F147D111000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F147CE17000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F147CC02000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F147C9E5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F147C63D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F147D51E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f147c65e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:50:49.804+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:51:49.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=29216 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:51:49.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:51:49.288+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:51:49.713+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888309:713853][29216:0x7f518d8c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:51:49.713+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:51:49.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f518c7f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F518C7D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD62FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F518D4A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F518D2A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F518CFAB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F518CD96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F518CB79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F518C7D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F518D6B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f518c7f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:51:49.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:52:49.867+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] MongoDB starting : pid=29500 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:52:49.874+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:52:49.924+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:52:50.262+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888370:262771][29500:0x7f5e228aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:52:50.262+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:52:50.273+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5e217de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5E217BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8567B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5E22495000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5E22291000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5E21F97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5E21D82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5E21B65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5E217BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5E2269E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5e217de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:52:50.273+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:53:49.404+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] MongoDB starting : pid=29725 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:53:49.411+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:53:49.462+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:53:49.875+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888429:875075][29725:0x7fe750bc9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:53:49.875+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:53:49.894+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe74faf9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE74FAD8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0892000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7507B0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7505AC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7502B2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE75009D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE74FE80000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE74FAD8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7509B9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe74faf9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:53:49.894+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:54:50.026+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] MongoDB starting : pid=29928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:54:50.034+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:54:50.084+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:54:50.482+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888490:482402][29928:0x7f7b3526dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:54:50.482+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:54:50.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7b3419d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7B3417C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7B34E54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7B34C50000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7B34956000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7B34741000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7B34524000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7B3417C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7B3505D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7b3419d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:54:50.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:55:49.638+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] MongoDB starting : pid=30153 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:55:49.646+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:55:49.697+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:55:50.073+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888550:73888][30153:0x7ffa59c16c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:55:50.073+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:55:50.085+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffa58b46635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFA58B25000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF310A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFA597FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFA595F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFA592FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFA590EA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFA58ECD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFA58B25000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFA59A06000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffa58b46635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:55:50.085+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:56:49.513+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] MongoDB starting : pid=30293 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:56:49.520+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:56:49.572+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:56:49.993+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888609:993393][30293:0x7fb9d05b8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:56:49.993+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:56:50.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb9cf4e8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB9CF4C7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB04B5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB9D019F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB9CFF9B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB9CFCA1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB9CFA8C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB9CF86F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB9CF4C7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB9D03A8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb9cf4e8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:56:50.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:57:49.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=30587 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:57:49.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:57:49.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:57:49.625+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888669:625980][30587:0x7f56b7b26c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:57:49.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:57:49.645+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f56b6a56635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F56B6A35000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6EF6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F56B770D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F56B7509000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F56B720F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F56B6FFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F56B6DDD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F56B6A35000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F56B7916000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f56b6a56635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:57:49.645+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:58:49.776+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:58:49.784+0000 I CONTROL [initandlisten] MongoDB starting : pid=30825 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:58:49.784+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:58:49.784+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:58:49.784+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:58:49.784+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:58:49.785+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:58:49.785+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:58:49.785+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:58:49.785+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:58:49.835+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:58:50.295+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888730:295742][30825:0x7f8c05f74c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:58:50.295+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:58:50.315+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8c04ea4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8C04E83000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF22878000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8C05B5B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8C05957000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8C0565D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8C05448000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8C0522B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8C04E83000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8C05D64000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8c04ea4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:58:50.315+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T09:59:49.480+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=31036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] modules: none 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] build environment: 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T09:59:49.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T09:59:49.538+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T09:59:49.854+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888789:854593][31036:0x7f6fe1ffcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T09:59:49.854+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T09:59:49.869+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6fe0f2c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6FE0F0B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98ADF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6FE1BE3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6FE19DF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6FE16E5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6FE14D0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6FE12B3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6FE0F0B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6FE1DEC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6fe0f2c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T09:59:49.869+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:00:49.153+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] MongoDB starting : pid=31268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:00:49.161+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:00:49.213+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:00:49.694+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888849:694759][31268:0x7f370e7fcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:00:49.694+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:00:49.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f370d72c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F370D70B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32E76000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F370E3E3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F370E1DF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F370DEE5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F370DCD0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F370DAB3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F370D70B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F370E5EC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f370d72c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:00:49.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:01:49.134+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] MongoDB starting : pid=31413 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:01:49.141+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:01:49.191+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:01:49.538+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888909:538346][31413:0x7fa0f9e82c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:01:49.538+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:01:49.548+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa0f8db2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA0F8D91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA0F9A69000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA0F9865000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA0F956B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA0F9356000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA0F9139000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA0F8D91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA0F9C72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa0f8db2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:01:49.548+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:02:50.022+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] MongoDB starting : pid=31714 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:02:50.029+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:02:50.079+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:02:50.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507888970:511369][31714:0x7f5ab95e2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:02:50.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:02:50.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ab8512635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5AB84F1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF912FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5AB91C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5AB8FC5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5AB8CCB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5AB8AB6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5AB8899000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5AB84F1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5AB93D2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ab8512635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:02:50.530+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:03:49.665+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] MongoDB starting : pid=31943 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:03:49.672+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:03:49.673+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:03:49.723+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:03:50.122+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889030:122858][31943:0x7ff9b0579c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:03:50.122+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:03:50.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9af4a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9AF488000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAF63D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF9B0160000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF9AFF5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF9AFC62000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF9AFA4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF9AF830000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9AF488000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9B0369000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9af4a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:03:50.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:04:49.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:04:49.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=32145 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:04:49.275+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:04:49.327+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:04:49.759+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889089:759323][32145:0x7fcfe5a50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:04:49.759+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:04:49.778+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcfe4980635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCFE495F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCFE5637000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCFE5433000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCFE5139000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCFE4F24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCFE4D07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCFE495F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCFE5840000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcfe4980635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:04:49.778+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:05:49.778+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] MongoDB starting : pid=32373 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:05:49.786+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:05:49.836+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:05:50.179+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889150:179206][32373:0x7f503f850c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:05:50.179+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:05:50.189+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f503e780635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F503E75F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A049000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F503F437000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F503F233000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F503EF39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F503ED24000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F503EB07000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F503E75F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F503F640000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f503e780635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:05:50.189+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:06:49.578+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] MongoDB starting : pid=32510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:06:49.586+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:06:49.635+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:06:50.054+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889210:54780][32510:0x7f96c4f79c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:06:50.054+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:06:50.074+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96c3ea9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F96C3E88000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEB2CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F96C4B60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96C495C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96C4662000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96C444D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96C4230000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96C3E88000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96C4D69000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96c3ea9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:06:50.074+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:07:49.198+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] MongoDB starting : pid=330 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:07:49.205+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:07:49.255+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:07:49.657+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889269:657435][330:0x7f533aecbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:07:49.657+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:07:49.676+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5339dfb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5339DDA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC06DA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F533AAB2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F533A8AE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F533A5B4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F533A39F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F533A182000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5339DDA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F533ACBB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5339dfb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:07:49.676+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:08:49.808+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=558 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:08:49.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:08:49.865+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:08:50.209+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889330:209335][558:0x7fa4d7faec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:08:50.209+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:08:50.219+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa4d6ede635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA4D6EBD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA4D7B95000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA4D7991000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA4D7697000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA4D7482000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA4D7265000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA4D6EBD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA4D7D9E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa4d6ede635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:08:50.219+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:09:49.342+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] MongoDB starting : pid=770 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:09:49.350+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:09:49.400+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:09:49.819+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889389:819355][770:0x7f9014c03c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:09:49.819+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:09:49.838+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9013b33635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9013B12000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF07BE3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F90147EA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F90145E6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F90142EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F90140D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9013EBA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9013B12000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F90149F3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9013b33635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:09:49.838+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:10:49.368+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] MongoDB starting : pid=1000 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:10:49.376+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:10:49.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:10:49.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889449:783336][1000:0x7fd7878d3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:10:49.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:10:49.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd786803635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7867E2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF998FB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7874BA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7872B6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD786FBC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD786DA7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD786B8A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7867E2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7876C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd786803635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:10:49.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:11:49.181+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] MongoDB starting : pid=1134 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:11:49.188+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:11:49.237+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:11:49.559+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889509:559743][1134:0x7f19ac40bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:11:49.559+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:11:49.570+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19ab33b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19AB31A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8B8BA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19ABFF2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19ABDEE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19ABAF4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19AB8DF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19AB6C2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19AB31A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19AC1FB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19ab33b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:11:49.570+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:12:49.694+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] MongoDB starting : pid=1523 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:12:49.701+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:12:49.751+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:12:50.154+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889570:154114][1523:0x7f02673c4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:12:50.154+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:12:50.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f02662f4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F02662D3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF432FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0266FAB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0266DA7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0266AAD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0266898000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F026667B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F02662D3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F02671B4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f02662f4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:12:50.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:13:49.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] MongoDB starting : pid=1774 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:13:49.307+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:13:49.359+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:13:49.743+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889629:743330][1774:0x7f2f9525bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:13:49.743+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:13:49.763+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f9418b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F9416A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F94E42000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F94C3E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F94944000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F9472F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F94512000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F9416A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F9504B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f9418b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:13:49.763+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:14:49.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=1988 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:14:49.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:14:49.948+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:14:50.298+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889690:298958][1988:0x7f294c278c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:14:50.299+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:14:50.318+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f294b1a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F294B187000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7188E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F294BE5F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F294BC5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F294B961000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F294B74C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F294B52F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F294B187000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F294C068000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f294b1a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:14:50.318+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:15:49.750+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] MongoDB starting : pid=2216 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:15:49.757+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:15:49.758+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:15:49.807+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:15:50.170+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889750:170643][2216:0x7eff9a9eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:15:50.170+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:15:50.195+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff9991e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF998FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB015000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF9A5D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF9A3D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF9A0D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF99EC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF99CA5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF998FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF9A7DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff9991e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:15:50.195+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:16:49.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=2357 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:16:49.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:16:49.763+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:16:50.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889810:62330][2357:0x7fd2eeacec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:16:50.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:16:50.073+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd2ed9fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD2ED9DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF82BA9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD2EE6B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD2EE4B1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD2EE1B7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD2EDFA2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD2EDD85000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD2ED9DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD2EE8BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd2ed9fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:16:50.073+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:17:49.207+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] MongoDB starting : pid=2655 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:17:49.215+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:17:49.265+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:17:49.695+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889869:695370][2655:0x7fc15eba8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:17:49.695+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:17:49.714+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc15dad8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC15DAB7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC54FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC15E78F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC15E58B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC15E291000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC15E07C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC15DE5F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC15DAB7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC15E998000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc15dad8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:17:49.714+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:18:49.838+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] MongoDB starting : pid=2873 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:18:49.845+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:18:49.895+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:18:50.264+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889930:264819][2873:0x7fedb0065c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:18:50.264+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:18:50.284+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fedaef95635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEDAEF74000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDEEDB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEDAFC4C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEDAFA48000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEDAF74E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEDAF539000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEDAF31C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEDAEF74000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEDAFE55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fedaef95635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:18:50.284+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:19:49.411+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] MongoDB starting : pid=3088 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:19:49.419+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:19:49.469+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:19:49.877+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507889989:877709][3088:0x7f0125959c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:19:49.877+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:19:49.897+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0124889635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0124868000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF990FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0125540000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F012533C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0125042000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0124E2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0124C10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0124868000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0125749000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0124889635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:19:49.897+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:20:49.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] MongoDB starting : pid=3324 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:20:49.413+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:20:49.463+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:20:49.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890049:787169][3324:0x7ffbce031c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:20:49.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:20:49.797+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffbccf61635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBCCF40000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76A4F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBCDC18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBCDA14000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBCD71A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBCD505000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBCD2E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBCCF40000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBCDE21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffbccf61635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:20:49.797+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:21:49.194+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] MongoDB starting : pid=3464 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:21:49.202+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:21:49.252+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:21:49.583+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890109:583420][3464:0x7f964ba16c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:21:49.583+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:21:49.594+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f964a946635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F964A925000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE00FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F964B5FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F964B3F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F964B0FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F964AEEA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F964ACCD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F964A925000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F964B806000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f964a946635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:21:49.594+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:22:49.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] MongoDB starting : pid=3769 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:22:49.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:22:49.784+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:22:50.154+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890170:154963][3769:0x7ff8e71a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:22:50.155+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:22:50.174+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8e60d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF8E60B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD58FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8E6D88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8E6B84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8E688A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF8E6675000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF8E6458000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF8E60B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF8E6F91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8e60d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:22:50.174+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:23:49.303+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] MongoDB starting : pid=3978 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:23:49.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:23:49.360+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:23:49.636+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890229:636854][3978:0x7f698b49fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:23:49.636+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:23:49.646+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f698a3cf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F698A3AE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC24FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F698B086000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F698AE82000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F698AB88000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F698A973000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F698A756000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F698A3AE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F698B28F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f698a3cf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:23:49.646+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:24:49.784+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] MongoDB starting : pid=4177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:24:49.792+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:24:49.843+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:24:50.187+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890290:187563][4177:0x7fed4c9e3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:24:50.187+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:24:50.207+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed4b913635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED4B8F2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF41AD7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED4C5CA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED4C3C6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED4C0CC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED4BEB7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED4BC9A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED4B8F2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED4C7D3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed4b913635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:24:50.207+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:25:49.650+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] MongoDB starting : pid=4332 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:25:49.657+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:25:49.706+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:25:50.063+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890350:63165][4332:0x7fa6d3328c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:25:50.063+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:25:50.073+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6d2258635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6D2237000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF640FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6D2F0F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6D2D0B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6D2A11000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6D27FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6D25DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6D2237000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6D3118000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6d2258635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:25:50.073+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:26:49.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] MongoDB starting : pid=4547 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:26:49.457+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:26:49.512+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:26:49.845+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890409:845151][4547:0x7f7cfce26c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:26:49.845+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:26:49.855+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7cfbd56635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CFBD35000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF5EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CFCA0D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CFC809000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CFC50F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CFC2FA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CFC0DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CFBD35000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CFCC16000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7cfbd56635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:26:49.855+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:27:49.974+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] MongoDB starting : pid=4712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:27:49.982+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:27:50.031+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:27:50.439+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890470:439466][4712:0x7f6dc0474c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:27:50.439+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:27:50.450+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6dbf3a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6DBF383000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA0364000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6DC005B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6DBFE57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6DBFB5D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6DBF948000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6DBF72B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6DBF383000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6DC0264000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6dbf3a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:27:50.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:28:49.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=5044 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:28:49.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:28:49.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:28:49.987+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890529:987969][5044:0x7fbedcf66c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:28:49.988+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:28:50.007+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbedbe96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBEDBE75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDFE2A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBEDCB4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBEDC949000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBEDC64F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBEDC43A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBEDC21D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBEDBE75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBEDCD56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbedbe96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:28:50.008+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:29:49.131+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] MongoDB starting : pid=5484 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:29:49.140+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:29:49.191+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:29:49.598+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890589:598214][5484:0x7fe789afac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:29:49.598+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:29:49.617+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe788a2a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE788A09000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE7896E1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE7894DD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE7891E3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE788FCE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE788DB1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE788A09000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE7898EA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe788a2a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:29:49.618+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:30:49.197+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] MongoDB starting : pid=5880 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:30:49.204+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:30:49.253+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:30:49.654+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890649:654018][5880:0x7f6c5f1b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:30:49.654+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:30:49.673+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6c5e0e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6C5E0C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C5ED9A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C5EB96000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C5E89C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C5E687000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6C5E46A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6C5E0C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C5EFA3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6c5e0e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:30:49.673+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:31:49.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=6177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:31:49.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:31:49.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:31:49.527+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890709:527384][6177:0x7f851c127c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:31:49.527+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:31:49.538+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f851b057635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F851B036000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0137F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F851BD0E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F851BB0A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F851B810000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F851B5FB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F851B3DE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F851B036000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F851BF17000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f851b057635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:31:49.538+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:32:49.675+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] MongoDB starting : pid=6446 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:32:49.682+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:32:49.732+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:32:50.029+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890770:29973][6446:0x7f6c00cd9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:32:50.030+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:32:50.043+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6bffc09635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6BFFBE8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF64FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6C008C0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6C006BC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6C003C2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6C001AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6BFFF90000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6BFFBE8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6C00AC9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6bffc09635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:32:50.043+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:33:49.159+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:33:49.166+0000 I CONTROL [initandlisten] MongoDB starting : pid=6748 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:33:49.167+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:33:49.217+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:33:49.588+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890829:588390][6748:0x7f8e9b25ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:33:49.588+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:33:49.608+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8e9a18e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8E9A16D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF47EA1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8E9AE45000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8E9AC41000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8E9A947000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8E9A732000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8E9A515000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8E9A16D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8E9B04E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8e9a18e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:33:49.608+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:34:49.747+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] MongoDB starting : pid=6976 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:34:49.754+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:34:49.803+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:34:50.226+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890890:226169][6976:0x7eff8e90cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:34:50.226+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:34:50.239+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff8d83c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF8D81B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF8E4F3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF8E2EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF8DFF5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF8DDE0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF8DBC3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF8D81B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF8E6FC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff8d83c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:34:50.239+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:35:49.462+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] MongoDB starting : pid=7220 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:35:49.470+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:35:49.521+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:35:49.802+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507890949:802472][7220:0x7f4db92d2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:35:49.802+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:35:49.813+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4db8202635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4DB81E1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8AFD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4DB8EB9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4DB8CB5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4DB89BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4DB87A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4DB8589000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4DB81E1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4DB90C2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4db8202635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:35:49.813+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:36:49.223+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] MongoDB starting : pid=7433 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:36:49.230+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:36:49.281+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:36:49.589+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891009:589908][7433:0x7f9a89230c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:36:49.589+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:36:49.600+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a88160635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A8813F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A88E17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A88C13000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A88919000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A88704000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A884E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A8813F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A89020000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a88160635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:36:49.600+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:37:49.731+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] MongoDB starting : pid=7595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:37:49.739+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:37:49.790+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:37:50.112+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891070:112080][7595:0x7fb2bc4c6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:37:50.112+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:37:50.132+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb2bb3f6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB2BB3D5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF86EC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB2BC0AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB2BBEA9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB2BBBAF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB2BB99A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB2BB77D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB2BB3D5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB2BC2B6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb2bb3f6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:37:50.132+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:38:49.264+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] MongoDB starting : pid=7853 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:38:49.271+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:38:49.322+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:38:49.701+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891129:701791][7853:0x7f80f862cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:38:49.701+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:38:49.713+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80f755c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80F753B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80F8213000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80F800F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80F7D15000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80F7B00000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80F78E3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80F753B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80F841C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80f755c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:38:49.713+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:39:49.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:39:49.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=8074 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:39:49.851+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:39:49.901+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:39:50.295+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891190:295141][8074:0x7fe684f50c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:39:50.295+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:39:50.314+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe683e80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE683E5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2F845000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE684B37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE684933000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE684639000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE684424000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE684207000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE683E5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE684D40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe683e80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:39:50.314+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:40:49.867+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] MongoDB starting : pid=8302 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:40:49.875+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:40:49.925+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:40:50.322+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891250:322449][8302:0x7f9b94784c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:40:50.322+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:40:50.333+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b936b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B93693000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD9CFD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B9436B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B94167000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B93E6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B93C58000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B93A3B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B93693000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B94574000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b936b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:40:50.333+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:41:49.819+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] MongoDB starting : pid=8528 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:41:49.826+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:41:49.877+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:41:50.270+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891310:270941][8528:0x7f7ea5b18c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:41:50.271+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:41:50.291+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ea4a48635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EA4A27000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDE853000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EA56FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EA54FB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EA5201000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EA4FEC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EA4DCF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EA4A27000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EA5908000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ea4a48635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:41:50.291+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:42:49.438+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] MongoDB starting : pid=8697 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:42:49.446+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:42:49.496+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:42:49.796+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891369:796807][8697:0x7f883259cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:42:49.797+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:42:49.807+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f88314cc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F88314AB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8832183000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8831F7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8831C85000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8831A70000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8831853000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F88314AB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F883238C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f88314cc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:42:49.807+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:43:49.938+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:43:49.945+0000 I CONTROL [initandlisten] MongoDB starting : pid=8964 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:43:49.946+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:43:49.996+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:43:50.379+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891430:379921][8964:0x7f772cc5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:43:50.380+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:43:50.404+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f772bb8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F772BB6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B971000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F772C846000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F772C642000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F772C348000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F772C133000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F772BF16000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F772BB6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F772CA4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f772bb8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:43:50.404+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:44:49.532+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] MongoDB starting : pid=9192 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:44:49.540+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:44:49.591+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:44:49.936+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891489:936301][9192:0x7f6b3f9b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:44:49.936+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:44:49.947+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6b3e8e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6B3E8BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9EDE9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6B3F597000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6B3F393000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6B3F099000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6B3EE84000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6B3EC67000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6B3E8BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6B3F7A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6b3e8e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:44:49.947+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:45:49.412+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] MongoDB starting : pid=9418 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:45:49.420+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:45:49.461+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:45:49.791+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891549:791036][9418:0x7fc411c8ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:45:49.791+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:45:49.810+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc410bbe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC410B9D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9EEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC411875000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC411671000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC411377000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC411162000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC410F45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC410B9D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC411A7E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc410bbe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:45:49.810+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:46:49.204+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:46:49.211+0000 I CONTROL [initandlisten] MongoDB starting : pid=9632 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:46:49.211+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:46:49.211+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:46:49.211+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:46:49.212+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:46:49.212+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:46:49.212+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:46:49.212+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:46:49.212+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:46:49.262+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:46:49.530+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891609:530590][9632:0x7f9cb388cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:46:49.530+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:46:49.542+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9cb27bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9CB279B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2CEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9CB3473000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9CB326F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9CB2F75000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9CB2D60000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9CB2B43000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9CB279B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9CB367C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9cb27bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:46:49.542+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:47:49.673+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] MongoDB starting : pid=9797 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:47:49.681+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:47:49.731+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:47:50.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891670:41084][9797:0x7f3927a79c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:47:50.041+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:47:50.060+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39269a9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3926988000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF32EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3927660000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F392745C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3927162000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3926F4D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3926D30000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3926988000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3927869000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39269a9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:47:50.060+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:48:49.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] MongoDB starting : pid=10069 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:48:49.182+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:48:49.232+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:48:49.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891729:490777][10069:0x7fd62e09cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:48:49.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:48:49.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd62cfcc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD62CFAB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF672FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD62DC83000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD62DA7F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD62D785000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD62D570000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD62D353000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD62CFAB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD62DE8C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd62cfcc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:48:49.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:49:49.633+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] MongoDB starting : pid=10293 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:49:49.640+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:49:49.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:49:50.025+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891790:25441][10293:0x7f2fb954bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:49:50.025+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:49:50.045+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2fb847b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2FB845A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8DC2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2FB9132000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2FB8F2E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2FB8C34000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2FB8A1F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2FB8802000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2FB845A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2FB933B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2fb847b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:49:50.045+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:50:49.516+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] MongoDB starting : pid=10524 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:50:49.525+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:50:49.578+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:50:49.948+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891849:948666][10524:0x7f2e2f332c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:50:49.948+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:50:49.968+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e2e262635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E2E241000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF160FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E2EF19000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E2ED15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E2EA1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E2E806000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E2E5E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E2E241000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E2F122000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e2e262635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:50:49.968+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:51:49.372+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] MongoDB starting : pid=10736 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:51:49.380+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:51:49.433+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:51:49.780+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891909:780917][10736:0x7f93fb909c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:51:49.781+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:51:49.801+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93fa839635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93FA818000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF25087000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93FB4F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93FB2EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93FAFF2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93FADDD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93FABC0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93FA818000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93FB6F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93fa839635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:51:49.801+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:52:49.936+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] MongoDB starting : pid=10899 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:52:49.943+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:52:49.944+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:52:49.944+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:52:49.994+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:52:50.241+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507891970:241155][10899:0x7f7deb6ecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:52:50.241+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:52:50.251+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dea61c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DEA5FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DEB2D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DEB0CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DEADD5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DEABC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DEA9A3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DEA5FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DEB4DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dea61c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:52:50.251+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:53:49.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] MongoDB starting : pid=11157 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:53:49.389+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:53:49.439+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:53:49.729+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892029:729099][11157:0x7f67a34cec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:53:49.729+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:53:49.739+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67a23fe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67A23DD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF16AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67A30B5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67A2EB1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67A2BB7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67A29A2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67A2785000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67A23DD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67A32BE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67a23fe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:53:49.739+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:54:49.870+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] MongoDB starting : pid=11380 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:54:49.878+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:54:49.928+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:54:50.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892090:296225][11380:0x7f3104d55c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:54:50.296+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:54:50.312+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3103c85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3103C64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F310493C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3104738000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F310443E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3104229000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F310400C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3103C64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3104B45000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3103c85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:54:50.312+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:55:49.444+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] MongoDB starting : pid=11604 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:55:49.453+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:55:49.503+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:55:49.961+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892149:961794][11604:0x7f5a2eba4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:55:49.961+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:55:49.981+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5a2dad4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5A2DAB3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF820FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5A2E78B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5A2E587000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5A2E28D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5A2E078000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5A2DE5B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5A2DAB3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5A2E994000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5a2dad4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:55:49.981+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:56:49.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=11809 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:56:49.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:56:49.441+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:56:49.832+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892209:832377][11809:0x7f7f8e4eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:56:49.832+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:56:49.852+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7f8d41e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7F8D3FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7F8E0D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7F8DED1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7F8DBD7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7F8D9C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7F8D7A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7F8D3FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7F8E2DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7f8d41e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:56:49.852+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:57:49.978+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:57:49.985+0000 I CONTROL [initandlisten] MongoDB starting : pid=11980 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:57:49.985+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:57:49.985+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:57:49.985+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:57:49.985+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:57:49.985+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:57:49.986+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:57:49.986+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:57:49.986+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:57:50.036+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:57:50.398+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892270:398510][11980:0x7f4237b76c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:57:50.398+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:57:50.409+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4236aa6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4236A85000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F423775D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4237559000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F423725F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F423704A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4236E2D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4236A85000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4237966000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4236aa6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:57:50.409+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:58:49.536+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:58:49.547+0000 I CONTROL [initandlisten] MongoDB starting : pid=12250 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:58:49.547+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:58:49.547+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:58:49.547+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:58:49.547+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:58:49.547+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:58:49.548+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:58:49.548+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:58:49.548+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:58:49.582+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:58:49.813+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892329:813926][12250:0x7fefbf013c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:58:49.813+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:58:49.825+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fefbdf43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFBDF22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE6D2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFBEBFA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFBE9F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFBE6FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFBE4E7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFBE2CA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFBDF22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFBEE03000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fefbdf43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:58:49.825+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T10:59:49.958+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] MongoDB starting : pid=12438 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] modules: none 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] build environment: 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T10:59:49.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T10:59:50.023+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T10:59:50.337+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892390:337725][12438:0x7f7dd7ff2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T10:59:50.337+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T10:59:50.348+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dd6f22635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DD6F01000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF93EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DD7BD9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DD79D5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DD76DB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DD74C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DD72A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DD6F01000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DD7DE2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dd6f22635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T10:59:50.348+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:00:49.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] MongoDB starting : pid=12610 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:00:49.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:00:49.527+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:00:49.893+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892449:893673][12610:0x7f39e8cb4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:00:49.893+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:00:49.912+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f39e7be4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F39E7BC3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F39E889B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F39E8697000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F39E839D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F39E8188000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F39E7F6B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F39E7BC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F39E8AA4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f39e7be4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:00:49.913+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:01:49.526+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:01:49.533+0000 I CONTROL [initandlisten] MongoDB starting : pid=12823 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:01:49.534+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:01:49.589+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:01:49.983+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892509:983283][12823:0x7f71e58cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:01:49.983+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:01:49.993+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f71e47ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F71E47DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD5AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F71E54B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71E52B2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71E4FB8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71E4DA3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F71E4B86000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F71E47DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F71E56BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f71e47ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:01:49.993+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:02:49.578+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] MongoDB starting : pid=13084 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:02:49.585+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:02:49.635+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:02:49.969+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892569:969348][13084:0x7f765e3d9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:02:49.969+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:02:49.980+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f765d309635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F765D2E8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB6AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F765DFC0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F765DDBC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F765DAC2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F765D8AD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F765D690000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F765D2E8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F765E1C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f765d309635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:02:49.980+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:03:49.109+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] MongoDB starting : pid=13207 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:03:49.120+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:03:49.181+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:03:49.510+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892629:510870][13207:0x7f9e73be9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:03:49.510+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:03:49.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e72b19635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E72AF8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E737D0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E735CC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E732D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E730BD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E72EA0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E72AF8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E739D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e72b19635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:03:49.530+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:04:49.659+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:04:49.666+0000 I CONTROL [initandlisten] MongoDB starting : pid=13484 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:04:49.666+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:04:49.666+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:04:49.666+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:04:49.666+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:04:49.666+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:04:49.667+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:04:49.667+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:04:49.667+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:04:49.716+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:04:50.115+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892690:115816][13484:0x7f522a48ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:04:50.115+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:04:50.136+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f52293ba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5229399000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F522A071000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5229E6D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5229B73000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F522995E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5229741000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5229399000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F522A27A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f52293ba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:04:50.136+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:05:49.266+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:05:49.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=13711 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:05:49.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:05:49.275+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:05:49.325+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:05:49.726+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892749:726341][13711:0x7fc83284bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:05:49.726+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:05:49.746+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc83177b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC83175A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA658F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC832432000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC83222E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC831F34000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC831D1F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC831B02000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC83175A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC83263B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc83177b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:05:49.746+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:06:49.139+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] MongoDB starting : pid=13917 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:06:49.147+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:06:49.197+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:06:49.578+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892809:578773][13917:0x7ff2ba1a4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:06:49.578+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:06:49.598+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff2b90d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF2B90B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FF2BAAB5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF2B9D8D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF2B9B89000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF2B988F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF2B967A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF2B945D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF2B90B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF2B9F96000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff2b90d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:06:49.598+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:07:49.736+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] MongoDB starting : pid=14173 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:07:49.744+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:07:49.793+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:07:50.094+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892870:94460][14173:0x7f0af0ebcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:07:50.094+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:07:50.105+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0aefdec635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0AEFDCB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06854000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0AF0AA3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0AF089F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0AF05A5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0AF0390000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0AF0173000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0AEFDCB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0AF0CAC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0aefdec635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:07:50.105+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:08:49.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=14296 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:08:49.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:08:49.290+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:08:49.569+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892929:569064][14296:0x7f67efe35c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:08:49.569+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:08:49.580+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67eed65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67EED44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4EC6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67EFA1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67EF818000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67EF51E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67EF309000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67EF0EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67EED44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67EFC25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67eed65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:08:49.580+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:09:49.716+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] MongoDB starting : pid=14902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:09:49.723+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:09:49.774+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:09:50.162+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507892990:162489][14902:0x7fdc31192c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:09:50.162+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:09:50.181+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc300c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC300A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF334F2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC30D79000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC30B75000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC3087B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC30666000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC30449000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC300A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC30F82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc300c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:09:50.181+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:10:49.309+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] MongoDB starting : pid=15162 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:10:49.316+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:10:49.369+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:10:49.689+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893049:689625][15162:0x7f2543883c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:10:49.689+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:10:49.701+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f25427b3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2542792000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0BEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F254346A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2543266000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2542F6C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2542D57000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2542B3A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2542792000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2543673000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f25427b3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:10:49.701+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:11:49.279+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] MongoDB starting : pid=15367 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:11:49.287+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:11:49.336+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:11:49.738+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893109:738182][15367:0x7f91d8ebec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:11:49.738+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:11:49.758+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91d7dee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91D7DCD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF372FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F91D8AA5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F91D88A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F91D85A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F91D8392000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F91D8175000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91D7DCD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91D8CAE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91d7dee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:11:49.758+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:12:49.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] MongoDB starting : pid=15641 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:12:49.905+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:12:49.956+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:12:50.343+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893170:343373][15641:0x7f51ec5a3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:12:50.343+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:12:50.363+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f51eb4d3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F51EB4B2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1D0D1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F51EC18A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F51EBF86000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F51EBC8C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F51EBA77000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F51EB85A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F51EB4B2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F51EC393000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f51eb4d3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:12:50.363+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:13:49.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:13:49.493+0000 I CONTROL [initandlisten] MongoDB starting : pid=15771 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:13:49.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:13:49.547+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:13:49.943+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893229:943775][15771:0x7f8fc4b41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:13:49.943+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:13:49.963+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8fc3a71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8FC3A50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8FC4728000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8FC4524000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8FC422A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8FC4015000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8FC3DF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8FC3A50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8FC4931000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8fc3a71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:13:49.964+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:14:49.086+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:14:49.093+0000 I CONTROL [initandlisten] MongoDB starting : pid=16052 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:14:49.093+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:14:49.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:14:49.143+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:14:49.459+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893289:459633][16052:0x7f2d2e946c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:14:49.459+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:14:49.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d2d876635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D2D855000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D2E52D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D2E329000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D2E02F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D2DE1A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D2DBFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D2D855000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D2E736000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d2d876635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:14:49.471+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:15:49.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] MongoDB starting : pid=16282 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:15:49.607+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:15:49.657+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:15:49.941+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893349:941617][16282:0x7f9a3a59ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:15:49.941+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:15:49.962+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a394ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A394A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF815E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A3A181000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A39F7D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A39C83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A39A6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A39851000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A394A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A3A38A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a394ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:15:49.962+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:16:49.459+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] MongoDB starting : pid=16484 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:16:49.467+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:16:49.518+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:16:49.893+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893409:893749][16484:0x7fd105c2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:16:49.893+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:16:49.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd104b5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD104B3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF88FE8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD105815000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD105611000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD105317000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD105102000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD104EE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD104B3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD105A1E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd104b5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:16:49.904+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:17:50.034+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] MongoDB starting : pid=16743 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:17:50.042+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:17:50.091+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:17:50.476+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893470:476944][16743:0x7fe31cb3cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:17:50.477+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:17:50.496+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe31ba6c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE31BA4B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEA2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE31C723000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE31C51F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE31C225000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE31C010000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE31BDF3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE31BA4B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE31C92C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe31ba6c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:17:50.496+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:18:49.622+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] MongoDB starting : pid=16864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:18:49.630+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:18:49.680+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:18:49.996+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893529:996828][16864:0x7f9abcaeec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:18:49.996+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:18:50.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9abba1e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9ABB9FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA115E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9ABC6D5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9ABC4D1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9ABC1D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9ABBFC2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9ABBDA5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9ABB9FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9ABC8DE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9abba1e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:18:50.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:19:49.147+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] MongoDB starting : pid=17138 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:19:49.155+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:19:49.204+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:19:49.606+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893589:606059][17138:0x7f5d7d532c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:19:49.606+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:19:49.625+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d7c462635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D7C441000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7A93000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D7D119000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D7CF15000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D7CC1B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D7CA06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D7C7E9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D7C441000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D7D322000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d7c462635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:19:49.625+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:20:49.750+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=17371 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:20:49.758+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:20:49.809+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:20:50.149+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893650:149621][17371:0x7f37c08e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:20:50.149+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:20:50.160+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f37bf814635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F37BF7F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1CDF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F37C04CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F37C02C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F37BFFCD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F37BFDB8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F37BFB9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F37BF7F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F37C06D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f37bf814635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:20:50.160+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:21:49.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=17573 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:21:49.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:21:49.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:21:50.168+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893710:168413][17573:0x7f45e85dcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:21:50.168+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:21:50.179+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45e750c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45E74EB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F45E81C3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F45E7FBF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F45E7CC5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F45E7AB0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F45E7893000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45E74EB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F45E83CC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45e750c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:21:50.179+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:22:49.311+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] MongoDB starting : pid=17836 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:22:49.318+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:22:49.368+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:22:49.694+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893769:694206][17836:0x7fdb721f5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:22:49.694+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:22:49.704+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb71125635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB71104000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8DAAF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB71DDC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB71BD8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB718DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB716C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB714AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB71104000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB71FE5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb71125635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:22:49.704+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:23:49.841+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=17961 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:23:49.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:23:49.903+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:23:50.265+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893830:265057][17961:0x7f984cadac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:23:50.265+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:23:50.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f984ba0a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F984B9E9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDC6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F984C6C1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F984C4BD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F984C1C3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F984BFAE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F984BD91000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F984B9E9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F984C8CA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f984ba0a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:23:50.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:24:49.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:24:49.421+0000 I CONTROL [initandlisten] MongoDB starting : pid=18233 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:24:49.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:24:49.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:24:49.864+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893889:864726][18233:0x7f554ec22c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:24:49.864+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:24:49.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f554db52635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F554DB31000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9AB5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F554E809000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F554E605000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F554E30B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F554E0F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F554DED9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F554DB31000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F554EA12000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f554db52635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:24:49.884+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:25:50.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:25:50.013+0000 I CONTROL [initandlisten] MongoDB starting : pid=18461 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:25:50.013+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:25:50.013+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:25:50.013+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:25:50.013+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:25:50.014+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:25:50.014+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:25:50.014+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:25:50.014+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:25:50.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:25:50.375+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507893950:375236][18461:0x7fb97326fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:25:50.375+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:25:50.394+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb97219f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB97217E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB972E56000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB972C52000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB972958000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB972743000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB972526000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB97217E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB97305F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb97219f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:25:50.394+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:26:49.506+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] MongoDB starting : pid=18688 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:26:49.513+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:26:49.563+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:26:49.856+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894009:856883][18688:0x7f86f4055c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:26:49.856+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:26:49.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86f2f85635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86F2F64000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8BEE3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86F3C3C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86F3A38000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86F373E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86F3529000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86F330C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86F2F64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86F3E45000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86f2f85635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:26:49.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:27:50.006+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] MongoDB starting : pid=18948 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:27:50.013+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:27:50.063+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:27:50.386+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894070:386447][18948:0x7f1e75434c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:27:50.386+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:27:50.397+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1e74364635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1E74343000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8EBA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1E7501B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1E74E17000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1E74B1D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1E74908000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1E746EB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1E74343000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1E75224000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1e74364635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:27:50.397+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:28:49.522+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] MongoDB starting : pid=19085 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:28:49.530+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:28:49.580+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:28:49.889+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894129:889818][19085:0x7f77426cdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:28:49.889+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:28:49.909+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f77415fd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F77415DC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF232FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F77422B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F77420B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7741DB6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7741BA1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7741984000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F77415DC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F77424BD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f77415fd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:28:49.909+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:29:50.040+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] MongoDB starting : pid=19357 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:29:50.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:29:50.098+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:29:50.392+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894190:392314][19357:0x7f11aac29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:29:50.392+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:29:50.402+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f11a9b59635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F11A9B38000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0259C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F11AA810000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F11AA60C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F11AA312000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F11AA0FD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F11A9EE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F11A9B38000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F11AAA19000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f11a9b59635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:29:50.402+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:30:49.532+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] MongoDB starting : pid=19586 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:30:49.539+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:30:49.605+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:30:49.932+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894249:932144][19586:0x7f1fcba35c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:30:49.932+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:30:49.955+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1fca965635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1FCA944000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE88FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1FCB61C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1FCB418000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1FCB11E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1FCAF09000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1FCACEC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1FCA944000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1FCB825000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1fca965635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:30:49.955+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:31:49.822+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] MongoDB starting : pid=19785 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:31:49.830+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:31:49.880+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:31:50.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894310:276797][19785:0x7f2686387c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:31:50.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:31:50.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f26852b7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2685296000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1BE2F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2685F6E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2685D6A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2685A70000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F268585B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F268563E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2685296000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2686177000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f26852b7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:31:50.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:32:49.423+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:32:49.434+0000 I CONTROL [initandlisten] MongoDB starting : pid=20051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:32:49.434+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:32:49.434+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:32:49.434+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:32:49.435+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:32:49.435+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:32:49.435+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:32:49.435+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:32:49.435+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:32:49.486+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:32:49.828+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894369:828605][20051:0x7fe1b5b8ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:32:49.828+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:32:49.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1b4abe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1B4A9D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9B84C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE1B5775000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE1B5571000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE1B5277000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE1B5062000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE1B4E45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1B4A9D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE1B597E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1b4abe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:32:49.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:33:49.972+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] MongoDB starting : pid=20171 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:33:49.979+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:33:50.032+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:33:50.353+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894430:353250][20171:0x7ff8f2973c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:33:50.353+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:33:50.364+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff8f18a3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF8F1882000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFCAB0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF8F255A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF8F2356000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF8F205C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF8F1E47000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF8F1C2A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF8F1882000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF8F2763000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff8f18a3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:33:50.364+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:34:49.495+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:34:49.502+0000 I CONTROL [initandlisten] MongoDB starting : pid=20338 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:34:49.502+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:34:49.502+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:34:49.502+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:34:49.502+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:34:49.503+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:34:49.503+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:34:49.503+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:34:49.503+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:34:49.552+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:34:49.856+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894489:856908][20338:0x7f113f52fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:34:49.856+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:34:49.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f113e45f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F113E43E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BEBA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F113F116000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F113EF12000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F113EC18000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F113EA03000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F113E7E6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F113E43E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F113F31F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f113e45f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:34:49.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:35:49.989+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] MongoDB starting : pid=20572 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:35:49.997+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:35:50.049+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:35:50.326+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894550:326903][20572:0x7f5965a7dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:35:50.326+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:35:50.337+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f59649ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F596498C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97E64000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5965664000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5965460000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5965166000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5964F51000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5964D34000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F596498C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F596586D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f59649ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:35:50.337+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:36:49.966+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:36:49.973+0000 I CONTROL [initandlisten] MongoDB starting : pid=20781 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:36:49.973+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:36:49.973+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:36:49.973+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:36:49.974+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:36:49.974+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:36:49.974+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:36:49.974+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:36:49.974+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:36:50.024+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:36:50.309+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894610:309324][20781:0x7faac0162c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:36:50.309+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:36:50.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faabf092635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAABF071000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0942E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAABFD49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAABFB45000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAABF84B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAABF636000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAABF419000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAABF071000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAABFF52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faabf092635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:36:50.319+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:37:49.450+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] MongoDB starting : pid=21064 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:37:49.457+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:37:49.458+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:37:49.458+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:37:49.509+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:37:49.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894669:783860][21064:0x7f7996bc1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:37:49.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:37:49.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7995af1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7995AD0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDCEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F79967A8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F79965A4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F79962AA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7996095000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7995E78000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7995AD0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F79969B1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7995af1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:37:49.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:38:49.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=21271 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:38:49.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:38:49.972+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:38:50.279+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894730:279594][21271:0x7fab25219c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:38:50.279+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:38:50.290+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fab24149635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAB24128000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAB24E00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB24BFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB24902000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB246ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB244D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB24128000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB25009000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fab24149635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:38:50.290+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:39:49.414+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] MongoDB starting : pid=21406 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:39:49.422+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:39:49.473+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:39:49.826+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894789:826652][21406:0x7f12f8d41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:39:49.826+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:39:49.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f12f7c71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F12F7C50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F12F8928000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F12F8724000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F12F842A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F12F8215000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F12F7FF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F12F7C50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F12F8B31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f12f7c71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:39:49.837+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:40:49.957+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] MongoDB starting : pid=21679 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:40:49.965+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:40:50.016+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:40:50.290+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894850:290524][21679:0x7fdd8d891c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:40:50.290+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:40:50.301+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd8c7c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD8C7A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF328FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD8D478000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD8D274000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD8CF7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD8CD65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD8CB48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD8C7A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD8D681000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd8c7c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:40:50.301+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:41:49.163+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] MongoDB starting : pid=21899 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:41:49.171+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:41:49.222+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:41:49.597+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894909:597869][21899:0x7f037f45dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:41:49.597+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:41:49.608+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f037e38d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F037E36C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF69CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F037F044000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F037EE40000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F037EB46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F037E931000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F037E714000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F037E36C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F037F24D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f037e38d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:41:49.608+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:42:49.748+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] MongoDB starting : pid=22165 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:42:49.756+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:42:49.809+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:42:50.141+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507894970:141487][22165:0x7f94378c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:42:50.141+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:42:50.161+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f94367f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F94367D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBABDC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F94374AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F94372AA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9436FB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9436D9B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9436B7E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F94367D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F94376B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f94367f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:42:50.161+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:43:49.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:43:49.294+0000 I CONTROL [initandlisten] MongoDB starting : pid=22384 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:43:49.295+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:43:49.344+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:43:49.643+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895029:643858][22384:0x7fdacca11c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:43:49.643+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:43:49.655+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdacb941635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDACB920000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDACC5F8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDACC3F4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDACC0FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDACBEE5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDACBCC8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDACB920000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDACC801000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdacb941635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:43:49.655+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:44:49.792+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] MongoDB starting : pid=22531 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:44:49.800+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:44:49.801+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:44:49.852+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:44:50.210+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895090:210426][22531:0x7fea8dcbdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:44:50.210+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:44:50.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fea8cbed635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEA8CBCC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CCD4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEA8D8A4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEA8D6A0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEA8D3A6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEA8D191000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEA8CF74000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEA8CBCC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEA8DAAD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fea8cbed635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:44:50.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:45:49.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] MongoDB starting : pid=22787 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:45:49.357+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:45:49.407+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:45:49.685+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895149:685713][22787:0x7fef1c035c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:45:49.685+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:45:49.696+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fef1af65635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEF1AF44000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1C6E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEF1BC1C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEF1BA18000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEF1B71E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEF1B509000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEF1B2EC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEF1AF44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEF1BE25000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fef1af65635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:45:49.696+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:46:49.640+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] MongoDB starting : pid=23020 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:46:49.648+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:46:49.699+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:46:50.021+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895210:21105][23020:0x7f4675390c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:46:50.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:46:50.032+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f46742c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F467429F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF55CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4674F77000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4674D73000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4674A79000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4674864000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4674647000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F467429F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4675180000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f46742c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:46:50.032+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:47:49.164+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] MongoDB starting : pid=23268 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:47:49.172+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:47:49.222+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:47:49.531+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895269:531944][23268:0x7fa10937dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:47:49.532+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:47:49.542+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1082ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA10828C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA108F64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA108D60000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA108A66000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA108851000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA108634000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA10828C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA10916D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1082ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:47:49.542+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:48:49.666+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] MongoDB starting : pid=23480 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:48:49.675+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:48:49.676+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:48:49.726+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:48:50.037+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895330:37703][23480:0x7f169a8d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:48:50.037+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:48:50.048+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1699807635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16997E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58E5D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F169A4BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F169A2BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1699FC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1699DAB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1699B8E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16997E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F169A6C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1699807635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:48:50.048+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:49:49.183+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] MongoDB starting : pid=23624 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:49:49.191+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:49:49.242+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:49:49.611+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895389:611569][23624:0x7f19545a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:49:49.611+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:49:49.631+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19534d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19534B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF502A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F195418E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1953F8A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1953C90000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1953A7B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F195385E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19534B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1954397000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19534d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:49:49.631+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:50:49.766+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:50:49.773+0000 I CONTROL [initandlisten] MongoDB starting : pid=23878 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:50:49.774+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:50:49.807+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:50:50.052+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895450:52392][23878:0x7ffcdbd1ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:50:50.052+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:50:50.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffcdac4e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFCDAC2D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD56F3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFCDB905000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFCDB701000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFCDB407000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFCDB1F2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFCDAFD5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFCDAC2D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFCDBB0E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffcdac4e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:50:50.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:51:49.923+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:51:49.930+0000 I CONTROL [initandlisten] MongoDB starting : pid=24111 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:51:49.931+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:51:49.980+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:51:50.327+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895510:327502][24111:0x7fb23e08fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:51:50.327+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:51:50.339+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb23cfbf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB23CF9E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDCA89000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB23DC76000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB23DA72000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB23D778000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB23D563000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB23D346000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB23CF9E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB23DE7F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb23cfbf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:51:50.339+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:52:49.470+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] MongoDB starting : pid=24365 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:52:49.478+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:52:49.528+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:52:49.844+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895569:844289][24365:0x7fc382ee5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:52:49.844+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:52:49.855+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc381e15635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC381DF4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA2C1F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC382ACC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3828C8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3825CE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3823B9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC38219C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC381DF4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC382CD5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc381e15635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:52:49.855+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:53:49.991+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] MongoDB starting : pid=24583 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:53:50.000+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:53:50.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:53:50.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895630:416119][24583:0x7f5bcea2ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:53:50.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:53:50.436+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5bcd95a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5BCD939000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5BCE611000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5BCE40D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5BCE113000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5BCDEFE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5BCDCE1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5BCD939000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5BCE81A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5bcd95a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:53:50.437+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:54:49.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] MongoDB starting : pid=24724 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:54:49.579+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:54:49.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:54:49.922+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895689:922563][24724:0x7f80b94a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:54:49.922+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:54:49.933+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80b83d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80B83AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF426FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F80B9087000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F80B8E83000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F80B8B89000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F80B8974000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F80B8757000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80B83AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80B9290000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80b83d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:54:49.933+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:55:49.068+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] MongoDB starting : pid=24974 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:55:49.075+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:55:49.076+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:55:49.076+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:55:49.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:55:49.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895749:463514][24974:0x7f1e0009dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:55:49.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:55:49.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1dfefcd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1DFEFAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1DFFC84000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1DFFA80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1DFF786000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1DFF571000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1DFF354000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1DFEFAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1DFFE8D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1dfefcd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:55:49.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:56:49.599+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:56:49.606+0000 I CONTROL [initandlisten] MongoDB starting : pid=25206 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:56:49.606+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:56:49.606+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:56:49.606+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:56:49.607+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:56:49.607+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:56:49.607+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:56:49.607+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:56:49.607+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:56:49.657+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:56:49.974+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895809:974562][25206:0x7f0be60f5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:56:49.974+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:56:49.994+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0be5025635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0BE5004000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5F025000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0BE5CDC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0BE5AD8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0BE57DE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0BE55C9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0BE53AC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0BE5004000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0BE5EE5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0be5025635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:56:49.994+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:57:49.125+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] MongoDB starting : pid=25442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:57:49.137+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:57:49.188+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:57:49.442+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895869:442464][25442:0x7f7851de2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:57:49.442+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:57:49.454+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7850d12635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7850CF1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2AABA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F78519C9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F78517C5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F78514CB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F78512B6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7851099000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7850CF1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7851BD2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7850d12635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:57:49.454+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:58:49.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:58:49.593+0000 I CONTROL [initandlisten] MongoDB starting : pid=25681 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:58:49.594+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:58:49.643+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:58:49.981+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895929:981009][25681:0x7fe62e4f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:58:49.981+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:58:50.001+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe62d423635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE62D402000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94C91000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE62E0DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE62DED6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE62DBDC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE62D9C7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE62D7AA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE62D402000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE62E2E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe62d423635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:58:50.001+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T11:59:49.140+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] MongoDB starting : pid=25818 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] modules: none 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] build environment: 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T11:59:49.149+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T11:59:49.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T11:59:49.479+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507895989:479687][25818:0x7f179abe8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T11:59:49.479+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T11:59:49.490+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1799b18635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1799AF7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF95288000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F179A7CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F179A5CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F179A2D1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F179A0BC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1799E9F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1799AF7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F179A9D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1799b18635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T11:59:49.490+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:00:49.773+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] MongoDB starting : pid=26124 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:00:49.781+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:00:49.832+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:00:50.210+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896050:210866][26124:0x7fb313917c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:00:50.210+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:00:50.230+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb312847635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB312826000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB3134FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB3132FA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB313000000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB312DEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB312BCE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB312826000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB313707000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb312847635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:00:50.230+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:01:49.454+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] MongoDB starting : pid=26354 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:01:49.462+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:01:49.511+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:01:49.884+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896109:884566][26354:0x7ff6917bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:01:49.884+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:01:49.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff6906ee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF6906CD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF6913A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF6911A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF690EA7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF690C92000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF690A75000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF6906CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF6915AE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff6906ee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:01:49.904+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:02:49.323+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=26588 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:02:49.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:02:49.380+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:02:49.753+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896169:753146][26588:0x7fc45f190c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:02:49.753+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:02:49.772+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc45e0c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC45E09F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB654000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC45ED77000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC45EB73000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC45E879000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC45E664000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC45E447000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC45E09F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC45EF80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc45e0c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:02:49.772+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:03:49.914+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] MongoDB starting : pid=26833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:03:49.922+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:03:49.972+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:03:50.360+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896230:360347][26833:0x7f2d95fbfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:03:50.360+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:03:50.379+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d94eef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D94ECE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF194FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D95BA6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D959A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D956A8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D95493000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D95276000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D94ECE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D95DAF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d94eef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:03:50.379+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:04:49.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] MongoDB starting : pid=26969 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:04:49.507+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:04:49.558+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:04:49.867+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896289:866414][26969:0x7f8bc6bbac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:04:49.867+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:04:49.886+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8bc5aea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8BC5AC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1A0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8BC67A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8BC659D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8BC62A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8BC608E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8BC5E71000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8BC5AC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8BC69AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8bc5aea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:04:49.886+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:05:50.003+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:05:50.010+0000 I CONTROL [initandlisten] MongoDB starting : pid=27231 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:05:50.011+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:05:50.064+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:05:50.431+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896350:431389][27231:0x7faf82016c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:05:50.431+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:05:50.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf80f46635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF80F25000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE07A2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF81BFD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF819F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF816FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF814EA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF812CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF80F25000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF81E06000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf80f46635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:05:50.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:06:49.605+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] MongoDB starting : pid=27463 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:06:49.613+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:06:49.663+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:06:50.062+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896410:62890][27463:0x7fc35e518c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:06:50.062+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:06:50.082+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc35d448635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC35D427000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAE6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC35E0FF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC35DEFB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC35DC01000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC35D9EC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC35D7CF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC35D427000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC35E308000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc35d448635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:06:50.082+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:07:49.211+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:07:49.218+0000 I CONTROL [initandlisten] MongoDB starting : pid=27688 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:07:49.218+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:07:49.218+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:07:49.218+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:07:49.219+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:07:49.219+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:07:49.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:07:49.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:07:49.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:07:49.269+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:07:49.667+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896469:667905][27688:0x7f958cd5bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:07:49.668+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:07:49.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f958bc8b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F958BC6A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F958C942000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F958C73E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F958C444000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F958C22F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F958C012000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F958BC6A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F958CB4B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f958bc8b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:07:49.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:08:49.811+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] MongoDB starting : pid=27913 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:08:49.819+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:08:49.870+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:08:50.168+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896530:168822][27913:0x7f0a2874cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:08:50.168+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:08:50.179+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0a2767c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0A2765B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0BBBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0A28333000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0A2812F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0A27E35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0A27C20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0A27A03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0A2765B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0A2853C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0a2767c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:08:50.180+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:09:49.322+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] MongoDB starting : pid=28055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:09:49.330+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:09:49.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:09:49.715+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896589:715130][28055:0x7f98738d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:09:49.715+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:09:49.725+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9872807635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F98727E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3B8DB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F98734BE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98732BA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9872FC0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9872DAB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9872B8E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98727E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98736C7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9872807635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:09:49.725+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:10:49.854+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] MongoDB starting : pid=28171 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:10:49.862+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:10:49.915+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:10:50.307+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896650:307159][28171:0x7f5313b13c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:10:50.307+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:10:50.326+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5312a43635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5312A22000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCB25F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53136FA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53134F6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53131FC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5312FE7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5312DCA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5312A22000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5313903000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5312a43635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:10:50.326+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:11:49.263+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] MongoDB starting : pid=28449 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:11:49.271+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:11:49.322+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:11:49.617+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896709:617483][28449:0x7f3e7736ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:11:49.617+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:11:49.628+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e7629a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E76279000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAF8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E76F51000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E76D4D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E76A53000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E7683E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E76621000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E76279000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E7715A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e7629a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:11:49.628+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:12:49.763+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:12:49.770+0000 I CONTROL [initandlisten] MongoDB starting : pid=28755 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:12:49.771+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:12:49.820+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:12:50.216+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896770:216318][28755:0x7fc8abf5dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:12:50.216+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:12:50.227+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8aae8d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8AAE6C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE57E2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8ABB44000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8AB940000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8AB646000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8AB431000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8AB214000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8AAE6C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8ABD4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8aae8d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:12:50.227+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:13:49.351+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=29005 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:13:49.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:13:49.359+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:13:49.410+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:13:49.730+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896829:729999][29005:0x7f54235cfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:13:49.730+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:13:49.740+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f54224ff635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F54224DE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF726FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F54231B6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5422FB2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5422CB8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5422AA3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5422886000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F54224DE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F54233BF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f54224ff635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:13:49.740+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:14:49.871+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] MongoDB starting : pid=29227 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:14:49.879+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:14:49.930+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:14:50.218+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896890:218782][29227:0x7f447f476c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:14:50.218+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:14:50.229+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f447e3a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F447E385000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F447F05D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F447EE59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F447EB5F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F447E94A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F447E72D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F447E385000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F447F266000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f447e3a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:14:50.229+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:15:49.353+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] MongoDB starting : pid=29341 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:15:49.361+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:15:49.410+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:15:49.711+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507896949:711122][29341:0x7fc8590e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:15:49.711+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:15:49.730+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc858016635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC857FF5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF58CE2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC858CCD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC858AC9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8587CF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8585BA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC85839D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC857FF5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC858ED6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc858016635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:15:49.730+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:16:49.586+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] MongoDB starting : pid=29659 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:16:49.594+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:16:49.644+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:16:49.939+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897009:939192][29659:0x7f0037952c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:16:49.939+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:16:49.949+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0036882635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0036861000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF732FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0037539000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0037335000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F003703B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0036E26000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0036C09000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0036861000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0037742000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0036882635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:16:49.949+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:17:49.069+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:17:49.077+0000 I CONTROL [initandlisten] MongoDB starting : pid=29883 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:17:49.077+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:17:49.078+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:17:49.125+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:17:49.416+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897069:416003][29883:0x7fba68a20c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:17:49.416+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:17:49.435+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fba67950635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBA6792F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBA68607000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBA68403000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBA68109000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBA67EF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBA67CD7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBA6792F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBA68810000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fba67950635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:17:49.435+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:18:49.574+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:18:49.581+0000 I CONTROL [initandlisten] MongoDB starting : pid=30135 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:18:49.582+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:18:49.632+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:18:49.951+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897129:951165][30135:0x7eff6afbfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:18:49.951+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:18:49.962+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff69eef635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF69ECE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF6ABA6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF6A9A2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF6A6A8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF6A493000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF6A276000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF69ECE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF6ADAF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff69eef635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:18:49.962+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:19:49.087+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] MongoDB starting : pid=30359 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:19:49.094+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:19:49.143+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:19:49.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897189:463399][30359:0x7f1a46639c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:19:49.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:19:49.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1a45569635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1A45548000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB6AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1A46220000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1A4601C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1A45D22000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1A45B0D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1A458F0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1A45548000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1A46429000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1a45569635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:19:49.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:20:49.597+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] MongoDB starting : pid=30475 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:20:49.604+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:20:49.655+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:20:50.046+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897250:46373][30475:0x7ffc2822dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:20:50.046+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:20:50.066+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc2715d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC2713C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC27E14000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC27C10000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC27916000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC27701000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC274E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC2713C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC2801D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc2715d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:20:50.067+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:21:49.817+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] MongoDB starting : pid=30760 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:21:49.825+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:21:49.876+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:21:50.194+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897310:194092][30760:0x7f08f7932c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:21:50.194+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:21:50.215+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f08f6862635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F08F6841000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCDDFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F08F7519000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F08F7315000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F08F701B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F08F6E06000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F08F6BE9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F08F6841000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F08F7722000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f08f6862635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:21:50.215+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:22:49.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] MongoDB starting : pid=30979 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:22:49.343+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:22:49.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:22:49.698+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897369:698180][30979:0x7f7dd28f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:22:49.698+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:22:49.718+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7dd1821635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DD1800000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2ECFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DD24D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DD22D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DD1FDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DD1DC5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DD1BA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DD1800000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DD26E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7dd1821635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:22:49.718+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:23:49.844+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] MongoDB starting : pid=31226 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:23:49.852+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:23:49.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:23:50.254+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897430:254197][31226:0x7f9687a1ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:23:50.254+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:23:50.264+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f968694a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9686929000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA9262000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9687601000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96873FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9687103000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9686EEE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9686CD1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9686929000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F968780A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f968694a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:23:50.264+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:24:49.386+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] MongoDB starting : pid=31448 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:24:49.394+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:24:49.445+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:24:49.783+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897489:783325][31448:0x7fe0749bac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:24:49.783+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:24:49.803+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0738ea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE0738C9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF21CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE0745A1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE07439D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE0740A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE073E8E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE073C71000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE0738C9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE0747AA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0738ea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:24:49.803+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:25:49.935+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] MongoDB starting : pid=31566 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:25:49.943+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:25:49.992+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:25:50.347+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897550:347774][31566:0x7f723baebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:25:50.347+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:25:50.359+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f723aa1b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F723A9FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC9342000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F723B6D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F723B4CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F723B1D4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F723AFBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F723ADA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F723A9FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F723B8DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f723aa1b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:25:50.359+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:26:49.878+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] MongoDB starting : pid=31856 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:26:49.886+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:26:49.936+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:26:50.232+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897610:232596][31856:0x7f2211cb9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:26:50.232+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:26:50.243+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2210be9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2210BC8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF18CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F22118A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F221169C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F22113A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F221118D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2210F70000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2210BC8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2211AA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2210be9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:26:50.244+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:27:49.111+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] MongoDB starting : pid=32066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:27:49.118+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:27:49.169+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:27:49.458+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897669:458823][32066:0x7eff95794c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:27:49.458+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:27:49.469+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff946c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF946A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF800E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF9537B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF95177000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF94E7D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF94C68000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF94A4B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF946A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF95584000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff946c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:27:49.469+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:28:49.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=32327 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:28:49.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:28:49.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:28:49.996+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897729:996857][32327:0x7f5b9a3a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:28:49.996+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:28:50.017+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5b992d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5B992B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE23B8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5B99F88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5B99D84000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5B99A8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5B99875000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5B99658000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5B992B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5B9A191000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5b992d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:28:50.017+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:29:49.140+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] MongoDB starting : pid=32546 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:29:49.148+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:29:49.199+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:29:49.537+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897789:537944][32546:0x7f9977c7fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:29:49.538+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:29:49.557+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9976baf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9976B8E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA96FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9977866000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9977662000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9977368000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9977153000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9976F36000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9976B8E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9977A6F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9976baf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:29:49.557+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:30:49.690+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] MongoDB starting : pid=32664 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:30:49.698+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:30:49.747+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:30:50.105+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897850:105069][32664:0x7fb73b87ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:30:50.105+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:30:50.124+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb73a7ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB73A78D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF184FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB73B465000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB73B261000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB73AF67000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB73AD52000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB73AB35000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB73A78D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB73B66E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb73a7ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:30:50.124+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:31:49.518+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] MongoDB starting : pid=486 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:31:49.526+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:31:49.576+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:31:49.901+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897909:901582][486:0x7f7253907c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:31:49.901+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:31:49.912+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7252837635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7252816000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF26C74000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F72534EE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F72532EA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7252FF0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7252DDB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7252BBE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7252816000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F72536F7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7252837635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:31:49.912+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:32:49.498+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] MongoDB starting : pid=712 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:32:49.505+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:32:49.555+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:32:49.846+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507897969:846749][712:0x7f3225386c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:32:49.846+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:32:49.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f32242b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3224295000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC60FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3224F6D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3224D69000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3224A6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F322485A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F322463D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3224295000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3225176000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f32242b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:32:49.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:33:49.977+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] MongoDB starting : pid=962 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:33:49.984+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:33:50.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:33:50.327+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898030:327378][962:0x7fa7cc016c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:33:50.327+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:33:50.341+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa7caf46635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA7CAF25000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C8A5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA7CBBFD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7CB9F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7CB6FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7CB4EA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7CB2CD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA7CAF25000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA7CBE06000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa7caf46635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:33:50.341+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:34:49.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] MongoDB starting : pid=1185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:34:49.487+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:34:49.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:34:49.864+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898089:864210][1185:0x7f62cc74cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:34:49.864+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:34:49.875+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f62cb67c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F62CB65B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF43FF7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F62CC333000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F62CC12F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F62CBE35000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F62CBC20000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F62CBA03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F62CB65B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F62CC53C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f62cb67c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:34:49.875+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:35:50.014+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] MongoDB starting : pid=1303 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:35:50.022+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:35:50.023+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:35:50.023+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:35:50.073+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:35:50.466+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898150:466258][1303:0x7f8dba27dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:35:50.466+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:35:50.486+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8db91ad635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8DB918C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8DB9E64000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8DB9C60000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8DB9966000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8DB9751000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8DB9534000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8DB918C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8DBA06D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8db91ad635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:35:50.486+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:36:49.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=1584 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:36:49.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:36:49.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:36:50.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898210:370889][1584:0x7f42f5617c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:36:50.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:36:50.390+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f42f4547635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F42F4526000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F42F51FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F42F4FFA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F42F4D00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F42F4AEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F42F48CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F42F4526000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F42F5407000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f42f4547635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:36:50.390+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:37:49.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=1793 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:37:49.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:37:49.739+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:37:50.003+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898270:3500][1793:0x7f14cf7b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:37:50.003+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:37:50.014+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f14ce6e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F14CE6C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBF834000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F14CF39B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F14CF197000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F14CEE9D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F14CEC88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F14CEA6B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F14CE6C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F14CF5A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f14ce6e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:37:50.014+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:38:49.135+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] MongoDB starting : pid=2046 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:38:49.142+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:38:49.193+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:38:49.469+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898329:469049][2046:0x7f5fb627ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:38:49.469+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:38:49.479+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5fb51aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5FB5189000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBC0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5FB5E61000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5FB5C5D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5FB5963000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5FB574E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5FB5531000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5FB5189000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5FB606A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5fb51aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:38:49.479+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:39:49.606+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] MongoDB starting : pid=2260 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:39:49.614+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:39:49.664+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:39:50.021+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898390:21764][2260:0x7f9828b36c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:39:50.021+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:39:50.041+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9827a66635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9827A45000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2BA69000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F982871D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9828519000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F982821F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F982800A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9827DED000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9827A45000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9828926000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9827a66635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:39:50.041+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:40:49.161+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] MongoDB starting : pid=2384 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:40:49.168+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:40:49.200+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:40:49.435+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898449:435082][2384:0x7f7507eafc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:40:49.435+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:40:49.446+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7506ddf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7506DBE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE66FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7507A96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7507892000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7507598000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7507383000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7507166000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7506DBE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7507C9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7506ddf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:40:49.446+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:41:49.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:41:49.874+0000 I CONTROL [initandlisten] MongoDB starting : pid=2668 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:41:49.874+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:41:49.874+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:41:49.874+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:41:49.875+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:41:49.875+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:41:49.875+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:41:49.875+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:41:49.875+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:41:49.925+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:41:50.233+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898510:233981][2668:0x7fa1bf677c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:41:50.234+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:41:50.245+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa1be5a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA1BE586000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF78AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA1BF25E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1BF05A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1BED60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1BEB4B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1BE92E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1BE586000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1BF467000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa1be5a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:41:50.245+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:42:49.335+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] MongoDB starting : pid=2881 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:42:49.342+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:42:49.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:42:49.676+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898569:676841][2881:0x7fee4f684c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:42:49.676+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:42:49.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee4e5b4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE4E593000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14AB3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE4F26B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE4F067000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE4ED6D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE4EB58000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE4E93B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE4E593000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE4F474000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee4e5b4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:42:49.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:43:49.810+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] MongoDB starting : pid=3094 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:43:49.818+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:43:49.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:43:50.138+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898630:138922][3094:0x7fc8c7dc4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:43:50.138+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:43:50.149+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8c6cf4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8C6CD3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF96AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8C79AB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8C77A7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8C74AD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8C7298000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8C707B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8C6CD3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8C7BB4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8c6cf4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:43:50.149+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:44:49.278+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] MongoDB starting : pid=3281 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:44:49.286+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:44:49.336+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:44:49.685+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898689:685195][3281:0x7fbeb1048c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:44:49.685+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:44:49.704+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbeaff78635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBEAFF57000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF1297000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBEB0C2F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBEB0A2B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBEB0731000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBEB051C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBEB02FF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBEAFF57000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBEB0E38000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbeaff78635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:44:49.704+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:45:49.827+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] MongoDB starting : pid=3511 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:45:49.834+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:45:49.884+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:45:50.208+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898750:208678][3511:0x7f9d8e8ebc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:45:50.208+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:45:50.220+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9d8d81b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9D8D7FA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF889E3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9D8E4D2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9D8E2CE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9D8DFD4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9D8DDBF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9D8DBA2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9D8D7FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9D8E6DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9d8d81b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:45:50.220+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:46:49.646+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] MongoDB starting : pid=3662 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:46:49.654+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:46:49.703+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:46:50.054+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898810:54061][3662:0x7fceef1a6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:46:50.054+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:46:50.065+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fceee0d6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCEEE0B5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE90E1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCEEED8D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCEEEB89000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCEEE88F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCEEE67A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCEEE45D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCEEE0B5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCEEEF96000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fceee0d6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:46:50.065+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:47:49.738+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] MongoDB starting : pid=3925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:47:49.746+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:47:49.796+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:47:50.188+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898870:188447][3925:0x7fd82a6b5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:47:50.188+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:47:50.209+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8295e5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8295C4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6EC7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD82A29C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD82A098000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD829D9E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD829B89000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD82996C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8295C4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD82A4A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8295e5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:47:50.209+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:48:49.339+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] MongoDB starting : pid=4177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:48:49.347+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:48:49.397+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:48:49.780+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898929:780361][4177:0x7f770b90ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:48:49.780+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:48:49.800+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f770a83c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F770A81B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F770C21B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F770B4F3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F770B2EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F770AFF5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F770ADE0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F770ABC3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F770A81B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F770B6FC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f770a83c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:48:49.800+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:49:49.943+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] MongoDB starting : pid=4378 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:49:49.950+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:49:50.000+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:49:50.287+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507898990:287760][4378:0x7f450559dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:49:50.287+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:49:50.298+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f45044cd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F45044AC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4505184000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4504F80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4504C86000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4504A71000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4504854000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F45044AC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F450538D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f45044cd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:49:50.298+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:50:49.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=4605 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:50:49.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:50:49.494+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:50:49.843+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899049:843779][4605:0x7f106c230c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:50:49.843+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:50:49.857+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f106b160635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F106B13F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8F8C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F106BE17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F106BC13000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F106B919000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F106B704000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F106B4E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F106B13F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F106C020000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f106b160635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:50:49.857+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:51:49.280+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] MongoDB starting : pid=4751 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:51:49.288+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:51:49.338+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:51:49.711+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899109:711929][4751:0x7f721b567c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:51:49.712+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:51:49.731+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f721a497635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F721A476000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1CDC6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F721B14E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F721AF4A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F721AC50000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F721AA3B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F721A81E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F721A476000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F721B357000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f721a497635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:51:49.731+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:52:49.230+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] MongoDB starting : pid=5187 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:52:49.238+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:52:49.291+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:52:49.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899169:556196][5187:0x7fe49f2b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:52:49.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:52:49.567+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe49e1e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE49E1C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF482FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE49EE9B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE49EC97000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE49E99D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE49E788000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE49E56B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE49E1C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE49F0A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe49e1e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:52:49.567+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:53:49.699+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] MongoDB starting : pid=5614 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:53:49.708+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:53:49.759+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:53:50.028+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899230:28592][5614:0x7f576d102c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:53:50.028+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:53:50.039+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f576c032635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F576C011000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F576CCE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F576CAE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F576C7EB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F576C5D6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F576C3B9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F576C011000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F576CEF2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f576c032635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:53:50.039+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:54:49.169+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] MongoDB starting : pid=5939 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:54:49.177+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:54:49.227+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:54:49.533+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899289:533295][5939:0x7f4c70f70c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:54:49.533+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:54:49.549+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4c6fea0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4C6FE7F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF80FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4C70B57000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4C70953000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4C70659000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4C70444000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4C70227000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4C6FE7F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4C70D60000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4c6fea0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:54:49.549+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:55:49.671+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] MongoDB starting : pid=6300 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:55:49.679+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:55:49.730+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:55:50.109+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899350:109483][6300:0x7f3e2e322c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:55:50.109+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:55:50.129+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3e2d252635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3E2D231000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF382FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3E2DF09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3E2DD05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3E2DA0B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3E2D7F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3E2D5D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3E2D231000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3E2E112000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3e2d252635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:55:50.129+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:56:49.538+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:56:49.545+0000 I CONTROL [initandlisten] MongoDB starting : pid=6528 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:56:49.546+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:56:49.597+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:56:49.971+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899409:971098][6528:0x7f86f3056c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:56:49.971+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:56:49.991+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f86f1f86635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F86F1F65000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCA0EB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F86F2C3D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F86F2A39000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F86F273F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F86F252A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F86F230D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F86F1F65000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F86F2E46000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f86f1f86635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:56:49.991+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:57:49.726+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] MongoDB starting : pid=6825 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:57:49.734+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:57:49.784+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:57:50.091+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899470:91244][6825:0x7fa9d55f7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:57:50.091+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:57:50.111+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9d4527635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9D4506000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF306FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9D51DE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9D4FDA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9D4CE0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9D4ACB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9D48AE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9D4506000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9D53E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9d4527635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:57:50.111+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:58:49.241+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=7093 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:58:49.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:58:49.298+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:58:49.621+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899529:621337][7093:0x7fc1ba03ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:58:49.621+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:58:49.632+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1b8f6e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1B8F4D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF92EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC1B9C25000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC1B9A21000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC1B9727000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1B9512000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC1B92F5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1B8F4D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1B9E2E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1b8f6e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:58:49.632+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T12:59:49.759+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T12:59:49.766+0000 I CONTROL [initandlisten] MongoDB starting : pid=7295 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] modules: none 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] build environment: 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T12:59:49.767+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T12:59:49.818+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T12:59:50.126+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899590:126325][7295:0x7f4333b30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T12:59:50.126+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T12:59:50.139+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4332a60635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4332A3F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF260FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4333717000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4333513000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4333219000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4333004000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4332DE7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4332A3F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4333920000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4332a60635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T12:59:50.139+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:00:49.256+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:00:49.263+0000 I CONTROL [initandlisten] MongoDB starting : pid=7515 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:00:49.263+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:00:49.263+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:00:49.263+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:00:49.263+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:00:49.264+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:00:49.264+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:00:49.264+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:00:49.264+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:00:49.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:00:49.579+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899649:579008][7515:0x7fc2a529ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:00:49.579+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:00:49.589+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc2a41ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC2A41AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF198FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC2A4E85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC2A4C81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC2A4987000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC2A4772000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC2A4555000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC2A41AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC2A508E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc2a41ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:00:49.589+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:01:50.011+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] MongoDB starting : pid=7665 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:01:50.019+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:01:50.072+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:01:50.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899710:377787][7665:0x7fd650b1cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:01:50.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:01:50.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd64fa4c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD64FA2B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4362B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD650703000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6504FF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD650205000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD64FFF0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD64FDD3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD64FA2B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD65090C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd64fa4c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:01:50.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:02:49.332+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] MongoDB starting : pid=7922 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:02:49.340+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:02:49.390+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:02:49.795+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899769:795300][7922:0x7f8c9e397c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:02:49.795+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:02:49.814+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8c9d2c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8C9D2A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A6E4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8C9DF7E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8C9DD7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8C9DA80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8C9D86B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8C9D64E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8C9D2A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8C9E187000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8c9d2c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:02:49.814+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:03:49.946+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] MongoDB starting : pid=8185 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:03:49.954+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:03:50.007+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:03:50.354+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899830:354481][8185:0x7f4e85d00c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:03:50.354+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:03:50.365+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e84c30635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E84C0F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E858E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E856E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E853E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E851D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E84FB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E84C0F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E85AF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e84c30635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:03:50.365+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:04:49.486+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] MongoDB starting : pid=8385 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:04:49.494+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:04:49.544+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:04:49.807+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899889:807122][8385:0x7ff1bc5a9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:04:49.807+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:04:49.817+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff1bb4d9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF1BB4B8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE9EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF1BC190000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF1BBF8C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF1BBC92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF1BBA7D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF1BB860000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF1BB4B8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF1BC399000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff1bb4d9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:04:49.817+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:05:49.950+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] MongoDB starting : pid=8622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:05:49.958+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:05:50.011+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:05:50.356+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507899950:356617][8622:0x7fa69549ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:05:50.356+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:05:50.376+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6943ce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6943AD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4C0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA695085000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA694E81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA694B87000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA694972000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA694755000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6943AD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA69528E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6943ce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:05:50.376+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:06:49.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] MongoDB starting : pid=8771 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:06:49.807+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:06:49.857+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:06:50.246+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900010:246275][8771:0x7f8007828c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:06:50.246+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:06:50.265+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8006758635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8006737000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C896000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F800740F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F800720B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8006F11000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8006CFC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8006ADF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8006737000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8007618000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8006758635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:06:50.266+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:07:49.611+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] MongoDB starting : pid=9023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:07:49.619+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:07:49.670+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:07:49.990+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900069:990754][9023:0x7f33e9962c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:07:49.990+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:07:50.002+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33e8892635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33E8871000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF057F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33E9549000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33E9345000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33E904B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33E8E36000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33E8C19000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33E8871000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33E9752000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33e8892635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:07:50.002+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:08:49.126+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] MongoDB starting : pid=9288 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:08:49.134+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:08:49.185+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:08:49.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900129:429271][9288:0x7fcaca01ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:08:49.429+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:08:49.439+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcac8f4a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCAC8F29000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCF4FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCAC9C01000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCAC99FD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCAC9703000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCAC94EE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCAC92D1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCAC8F29000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCAC9E0A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcac8f4a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:08:49.439+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:09:49.558+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] MongoDB starting : pid=9496 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:09:49.566+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:09:49.617+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:09:49.949+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900189:949638][9496:0x7f3001176c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:09:49.949+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:09:49.960+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f30000a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3000085000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2FEB2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3000D5D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3000B59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F300085F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F300064A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F300042D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3000085000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3000F66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f30000a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:09:49.960+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:10:49.102+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] MongoDB starting : pid=9718 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:10:49.114+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:10:49.174+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:10:49.524+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900249:524449][9718:0x7f3766c77c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:10:49.524+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:10:49.537+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3765ba7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3765B86000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8FE7E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F376685E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F376665A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3766360000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F376614B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3765F2E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3765B86000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3766A67000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3765ba7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:10:49.537+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:11:49.947+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] MongoDB starting : pid=9864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:11:49.955+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:11:50.018+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:11:50.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900310:370134][9864:0x7fe93224bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:11:50.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:11:50.382+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe93117b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE93115A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF40FF4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE931E32000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE931C2E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE931934000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE93171F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE931502000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE93115A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE93203B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe93117b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:11:50.382+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:12:49.807+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] MongoDB starting : pid=10132 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:12:49.815+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:12:49.866+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:12:50.255+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900370:255022][10132:0x7f6bdc4dbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:12:50.255+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:12:50.274+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6bdb40b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6BDB3EA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4F0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6BDC0C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6BDBEBE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6BDBBC4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6BDB9AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6BDB792000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6BDB3EA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6BDC2CB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6bdb40b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:12:50.274+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:13:49.395+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] MongoDB starting : pid=10412 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:13:49.402+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:13:49.453+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:13:49.776+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900429:776644][10412:0x7f70ae72ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:13:49.776+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:13:49.788+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f70ad65a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F70AD639000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF818FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F70AE311000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F70AE10D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F70ADE13000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F70ADBFE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F70AD9E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F70AD639000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F70AE51A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f70ad65a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:13:49.788+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:14:49.916+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] MongoDB starting : pid=10614 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:14:49.924+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:14:49.974+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:14:50.270+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900490:270758][10614:0x7f714e262c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:14:50.270+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:14:50.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f714d192635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F714D171000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F714DE49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F714DC45000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F714D94B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F714D736000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F714D519000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F714D171000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F714E052000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f714d192635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:14:50.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:15:49.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] MongoDB starting : pid=10833 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:15:49.414+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:15:49.465+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:15:49.773+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900549:773480][10833:0x7f91a2e33c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:15:49.773+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:15:49.793+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f91a1d63635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F91A1D42000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF526FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F91A2A1A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F91A2816000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F91A251C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F91A2307000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F91A20EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F91A1D42000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F91A2C23000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f91a1d63635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:15:49.793+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:16:49.248+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:16:49.258+0000 I CONTROL [initandlisten] MongoDB starting : pid=10979 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:16:49.258+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:16:49.258+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:16:49.258+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:16:49.259+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:16:49.259+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:16:49.259+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:16:49.259+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:16:49.259+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:16:49.313+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:16:49.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900609:674876][10979:0x7ff762131c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:16:49.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:16:49.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff761061635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF761040000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9AEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF761D18000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF761B14000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF76181A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF761605000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF7613E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF761040000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF761F21000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff761061635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:16:49.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:17:49.157+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] MongoDB starting : pid=11201 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:17:49.166+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:17:49.218+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:17:49.542+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900669:542963][11201:0x7f7eacd43c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:17:49.543+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:17:49.553+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7eabc73635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EABC52000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1AE12000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EAC92A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EAC726000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EAC42C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EAC217000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EABFFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EABC52000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EACB33000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7eabc73635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:17:49.554+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:18:49.682+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] MongoDB starting : pid=11409 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:18:49.690+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:18:49.741+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:18:50.110+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900730:110318][11409:0x7f3d7f09dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:18:50.110+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:18:50.129+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3d7dfcd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3D7DFAC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF9608000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3D7EC84000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3D7EA80000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3D7E786000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3D7E571000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3D7E354000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3D7DFAC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3D7EE8D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3d7dfcd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:18:50.129+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:19:49.255+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] MongoDB starting : pid=11608 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:19:49.264+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:19:49.321+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:19:49.649+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900789:649472][11608:0x7fc00e68bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:19:49.649+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:19:49.662+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc00d5bb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC00D59A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF98FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC00E272000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC00E06E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC00DD74000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC00DB5F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC00D942000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC00D59A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC00E47B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc00d5bb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:19:49.662+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:20:49.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] MongoDB starting : pid=11829 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:20:49.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:20:49.849+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:20:50.156+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900850:156090][11829:0x7f4d46fa1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:20:50.156+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:20:50.166+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4d45ed1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4D45EB0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4D46B88000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4D46984000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4D4668A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4D46475000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4D46258000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4D45EB0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4D46D91000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4d45ed1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:20:50.166+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:21:49.585+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] MongoDB starting : pid=12066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:21:49.592+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:21:49.657+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:21:50.022+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900910:22792][12066:0x7f7bf9d41c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:21:50.022+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:21:50.042+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7bf8c71635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7BF8C50000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC24C0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7BF9928000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7BF9724000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7BF942A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7BF9215000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7BF8FF8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7BF8C50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7BF9B31000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7bf8c71635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:21:50.042+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:22:49.883+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] MongoDB starting : pid=12186 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:22:49.891+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:22:49.940+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:22:50.296+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507900970:296551][12186:0x7ff98d6a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:22:50.296+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:22:50.307+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff98c5d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF98C5B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF98D288000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF98D084000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF98CD8A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF98CB75000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF98C958000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF98C5B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF98D491000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff98c5d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:22:50.307+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:23:49.438+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] MongoDB starting : pid=12508 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:23:49.446+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:23:49.495+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:23:49.784+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901029:784067][12508:0x7f085796bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:23:49.784+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:23:49.794+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f085689b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F085687A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CCA1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0857552000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F085734E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0857054000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0856E3F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0856C22000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F085687A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F085775B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f085689b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:23:49.794+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:24:49.928+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] MongoDB starting : pid=12715 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:24:49.940+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:24:49.998+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:24:50.349+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901090:349302][12715:0x7f21a06dec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:24:50.349+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:24:50.369+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f219f60e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F219F5ED000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA28FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F21A02C5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F21A00C1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F219FDC7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F219FBB2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F219F995000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F219F5ED000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F21A04CE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f219f60e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:24:50.369+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:25:49.490+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] MongoDB starting : pid=12935 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:25:49.498+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:25:49.549+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:25:49.871+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901149:871411][12935:0x7f602b924c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:25:49.871+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:25:49.882+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f602a854635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F602A833000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F602B50B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F602B307000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F602B00D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F602ADF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F602ABDB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F602A833000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F602B714000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f602a854635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:25:49.882+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:26:49.318+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] MongoDB starting : pid=13164 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:26:49.327+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:26:49.379+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:26:49.766+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901209:766629][13164:0x7f7ca24fdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:26:49.766+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:26:49.786+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ca142d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7CA140C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9D6DF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7CA20E4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7CA1EE0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7CA1BE6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7CA19D1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7CA17B4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7CA140C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7CA22ED000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ca142d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:26:49.786+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:27:49.802+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:27:49.809+0000 I CONTROL [initandlisten] MongoDB starting : pid=13296 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:27:49.810+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:27:49.859+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:27:50.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901270:161142][13296:0x7f7b1e989c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:27:50.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:27:50.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7b1d8b9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7B1D898000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7B1E570000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7B1E36C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7B1E072000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7B1DE5D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7B1DC40000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7B1D898000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7B1E779000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7b1d8b9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:27:50.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:28:49.307+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] MongoDB starting : pid=13616 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:28:49.314+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:28:49.364+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:28:49.661+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901329:661574][13616:0x7ffbaea16c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:28:49.661+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:28:49.672+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffbad946635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFBAD925000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFBAE5FD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFBAE3F9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFBAE0FF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFBADEEA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFBADCCD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFBAD925000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFBAE806000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffbad946635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:28:49.672+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:29:49.798+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] MongoDB starting : pid=13816 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:29:49.806+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:29:49.857+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:29:50.175+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901390:175156][13816:0x7f55b0c90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:29:50.175+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:29:50.186+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f55afbc0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F55AFB9F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7AA93000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F55B0877000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F55B0673000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F55B0379000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F55B0164000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F55AFF47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F55AFB9F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F55B0A80000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f55afbc0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:29:50.186+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:30:49.313+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] MongoDB starting : pid=14036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:30:49.320+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:30:49.369+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:30:49.713+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901449:713966][14036:0x7ffb9eb44c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:30:49.714+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:30:49.724+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffb9da74635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFB9DA53000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C3FC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFB9E72B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFB9E527000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFB9E22D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFB9E018000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFB9DDFB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFB9DA53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFB9E934000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffb9da74635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:30:49.724+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:31:49.123+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] MongoDB starting : pid=14265 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:31:49.130+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:31:49.182+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:31:49.556+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901509:556864][14265:0x7fdd31e84c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:31:49.556+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:31:49.576+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd30db4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD30D93000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDDC9C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDD31A6B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDD31867000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD3156D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD31358000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD3113B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD30D93000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDD31C74000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd30db4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:31:49.577+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:32:49.341+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] MongoDB starting : pid=14425 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:32:49.348+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:32:49.398+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:32:49.722+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901569:722535][14425:0x7fe8e211ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:32:49.722+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:32:49.742+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe8e104e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE8E102D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE8E1D05000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE8E1B01000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE8E1807000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE8E15F2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE8E13D5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE8E102D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE8E1F0E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe8e104e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:32:49.742+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:33:49.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] MongoDB starting : pid=15064 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:33:49.874+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:33:49.925+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:33:50.291+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901630:291099][15064:0x7ff52a626c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:33:50.291+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:33:50.311+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff529556635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF529535000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF52A20D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF52A009000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF529D0F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF529AFA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF5298DD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF529535000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF52A416000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff529556635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:33:50.311+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:34:49.448+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] MongoDB starting : pid=15270 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:34:49.453+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:34:49.488+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:34:49.829+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901689:829177][15270:0x7fb0cf050c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:34:49.829+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:34:49.848+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb0cdf80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB0CDF5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08E65000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB0CEC37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB0CEA33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB0CE739000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB0CE524000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB0CE307000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB0CDF5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB0CEE40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb0cdf80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:34:49.848+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:35:49.981+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] MongoDB starting : pid=15510 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:35:49.988+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:35:50.037+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:35:50.370+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901750:370044][15510:0x7f814c806c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:35:50.370+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:35:50.389+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f814b736635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F814B715000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F814C3ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F814C1E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F814BEEF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F814BCDA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F814BABD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F814B715000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F814C5F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f814b736635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:35:50.389+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:36:49.814+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] MongoDB starting : pid=15740 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:36:49.822+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:36:49.871+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:36:50.143+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901810:143397][15740:0x7f73103d5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:36:50.143+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:36:50.163+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f730f305635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F730F2E4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1253C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F730FFBC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F730FDB8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F730FABE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F730F8A9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F730F68C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F730F2E4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F73101C5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f730f305635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:36:50.163+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:37:49.480+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] MongoDB starting : pid=15859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:37:49.488+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:37:49.539+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:37:49.874+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901869:874162][15859:0x7f1f93d20c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:37:49.874+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:37:49.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1f92c50635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1F92C2F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD78FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1F93907000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1F93703000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1F93409000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1F931F4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1F92FD7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1F92C2F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1F93B10000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1f92c50635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:37:49.884+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:38:50.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] MongoDB starting : pid=16177 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:38:50.047+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:38:50.101+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:38:50.364+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901930:364311][16177:0x7fc625399c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:38:50.364+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:38:50.376+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc6242c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC6242A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF968A4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC624F80000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC624D7C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC624A82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC62486D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC624650000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC6242A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC625189000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc6242c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:38:50.376+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:39:49.503+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] MongoDB starting : pid=16378 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:39:49.511+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:39:49.564+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:39:49.850+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507901989:850266][16378:0x7fa254323c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:39:49.850+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:39:49.870+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa253253635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA253232000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF046FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA253F0A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA253D06000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA253A0C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA2537F7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA2535DA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA253232000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA254113000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa253253635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:39:49.870+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:40:50.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:40:50.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=16596 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:40:50.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:40:50.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:40:50.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:40:50.015+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:40:50.016+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:40:50.016+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:40:50.016+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:40:50.016+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:40:50.070+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:40:50.460+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902050:460915][16596:0x7f8ce497ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:40:50.460+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:40:50.472+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8ce38aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8CE3889000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8CE4561000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8CE435D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8CE4063000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8CE3E4E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8CE3C31000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8CE3889000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8CE476A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8ce38aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:40:50.472+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:41:49.882+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] MongoDB starting : pid=16827 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:41:49.890+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:41:49.941+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:41:50.335+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902110:335779][16827:0x7f2d03b42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:41:50.335+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:41:50.346+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2d02a72635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2D02A51000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3D055000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2D03729000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2D03525000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2D0322B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2D03016000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2D02DF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2D02A51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2D03932000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2d02a72635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:41:50.346+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:42:49.676+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] MongoDB starting : pid=16954 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:42:49.684+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:42:49.735+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:42:50.119+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902170:119207][16954:0x7f3dba504c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:42:50.119+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:42:50.138+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3db9434635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3DB9413000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF15CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3DBA0EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3DB9EE7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3DB9BED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3DB99D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3DB97BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3DB9413000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3DBA2F4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3db9434635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:42:50.138+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:43:49.266+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=17278 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:43:49.274+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:43:49.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:43:49.602+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902229:602237][17278:0x7f3651ab2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:43:49.602+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:43:49.612+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f36509e2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F36509C1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEF48A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3651699000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3651495000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F365119B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3650F86000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3650D69000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F36509C1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F36518A2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f36509e2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:43:49.612+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:44:49.739+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:44:49.746+0000 I CONTROL [initandlisten] MongoDB starting : pid=17487 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:44:49.747+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:44:49.796+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:44:50.191+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902290:191265][17487:0x7f5d27ee0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:44:50.191+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:44:50.210+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5d26e10635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5D26DEF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5D27AC7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5D278C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5D275C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5D273B4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5D27197000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5D26DEF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5D27CD0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5d26e10635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:44:50.210+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:45:49.336+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] MongoDB starting : pid=17707 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:45:49.344+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:45:49.393+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:45:49.707+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902349:707208][17707:0x7fe70e0f6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:45:49.707+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:45:49.717+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe70d026635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE70D005000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0729B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE70DCDD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE70DAD9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE70D7DF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE70D5CA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE70D3AD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE70D005000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE70DEE6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe70d026635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:45:49.717+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:46:49.196+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] MongoDB starting : pid=17938 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:46:49.204+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:46:49.254+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:46:49.532+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902409:532020][17938:0x7fa5fde4fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:46:49.532+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:46:49.542+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa5fcd7f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA5FCD5E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4A10F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA5FDA36000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA5FD832000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA5FD538000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA5FD323000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA5FD106000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA5FCD5E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA5FDC3F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa5fcd7f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:46:49.542+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:47:49.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] MongoDB starting : pid=18055 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:47:49.900+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:47:49.951+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:47:50.221+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902470:221448][18055:0x7f67dd28ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:47:50.221+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:47:50.231+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f67dc1be635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F67DC19D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF98AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F67DCE75000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F67DCC71000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F67DC977000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F67DC762000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F67DC545000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F67DC19D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F67DD07E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f67dc1be635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:47:50.231+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:48:49.373+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] MongoDB starting : pid=18376 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:48:49.384+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:48:49.437+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:48:49.709+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902529:709780][18376:0x7f2c946aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:48:49.709+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:48:49.721+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2c935de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2C935BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEDBE9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2C94295000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2C94091000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2C93D97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2C93B82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2C93965000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2C935BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2C9449E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2c935de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:48:49.722+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:49:49.842+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:49:49.849+0000 I CONTROL [initandlisten] MongoDB starting : pid=18580 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:49:49.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:49:49.899+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:49:50.193+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902590:193424][18580:0x7f7140c03c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:49:50.193+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:49:50.204+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f713fb35635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F713FB14000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F7141514000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F71407EC000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F71405E8000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F71402EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F71400D9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F713FEBC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F713FB14000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F71409F5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f713fb35635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:49:50.204+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:50:49.324+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] MongoDB starting : pid=18801 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:50:49.331+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:50:49.362+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:50:49.657+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902649:657905][18801:0x7f4ad28c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:50:49.657+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:50:49.668+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4ad17f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4AD17D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFC6EE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4AD24AE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4AD22AA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4AD1FB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4AD1D9B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4AD1B7E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4AD17D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4AD26B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4ad17f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:50:49.668+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:51:49.202+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] MongoDB starting : pid=19037 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:51:49.210+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:51:49.260+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:51:49.540+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902709:540257][19037:0x7fb1e0374c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:51:49.540+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:51:49.550+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb1df2a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1DF283000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF38CEB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB1DFF5B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1DFD57000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB1DFA5D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB1DF848000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1DF62B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1DF283000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB1E0164000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb1df2a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:51:49.550+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:52:49.691+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] MongoDB starting : pid=19158 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:52:49.699+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:52:49.749+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:52:50.016+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902770:16946][19158:0x7fb5ab01ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:52:50.017+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:52:50.027+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb5a9f4e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB5A9F2D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFECCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB5AAC05000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB5AAA01000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB5AA707000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB5AA4F2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB5AA2D5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5A9F2D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB5AAE0E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb5a9f4e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:52:50.027+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:53:49.267+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:53:49.274+0000 I CONTROL [initandlisten] MongoDB starting : pid=19371 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:53:49.275+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:53:49.324+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:53:49.603+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902829:603816][19371:0x7ffc63b29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:53:49.603+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:53:49.614+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffc62a59635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFC62A38000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4406D000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFC63710000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFC6350C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFC63212000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFC62FFD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFC62DE0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFC62A38000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFC63919000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffc62a59635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:53:49.614+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:54:49.738+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] MongoDB starting : pid=19581 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:54:49.745+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:54:49.796+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:54:50.098+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902890:98846][19581:0x7f388becdc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:54:50.098+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:54:50.117+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f388adfd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F388ADDC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF40FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F388BAB4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F388B8B0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F388B5B6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F388B3A1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F388B184000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F388ADDC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F388BCBD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f388adfd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:54:50.117+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:55:49.243+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:55:49.250+0000 I CONTROL [initandlisten] MongoDB starting : pid=19798 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:55:49.251+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:55:49.301+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:55:49.673+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507902949:673878][19798:0x7f813f814c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:55:49.673+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:55:49.693+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f813e744635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F813E723000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2244C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F813F3FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F813F1F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F813EEFD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F813ECE8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F813EACB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F813E723000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F813F604000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f813e744635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:55:49.693+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:56:49.155+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] MongoDB starting : pid=20028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:56:49.164+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:56:49.216+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:56:49.513+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903009:513680][20028:0x7fbaeae09c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:56:49.513+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:56:49.532+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbae9d39635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBAE9D18000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39C1F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBAEA9F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBAEA7EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBAEA4F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBAEA2DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBAEA0C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBAE9D18000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBAEABF9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbae9d39635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:56:49.532+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:57:49.650+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] MongoDB starting : pid=20236 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:57:49.658+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:57:49.708+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:57:50.002+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903070:2499][20236:0x7f413294fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:57:50.002+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:57:50.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f413187f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F413185E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF42AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4132536000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4132332000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4132038000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4131E23000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4131C06000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F413185E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F413273F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f413187f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:57:50.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:58:49.808+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] MongoDB starting : pid=20412 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:58:49.816+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:58:49.878+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:58:50.154+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903130:153991][20412:0x7fc07bc8bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:58:50.154+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:58:50.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc07abbb635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC07AB9A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF688FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC07B872000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC07B66E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC07B374000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC07B15F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC07AF42000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC07AB9A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC07BA7B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc07abbb635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:58:50.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T13:59:49.302+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T13:59:49.309+0000 I CONTROL [initandlisten] MongoDB starting : pid=20676 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] modules: none 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] build environment: 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T13:59:49.310+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T13:59:49.360+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T13:59:49.748+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903189:748748][20676:0x7fa3c3b2ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T13:59:49.748+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T13:59:49.759+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa3c2a5e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3C2A3D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF794FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3C3715000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3C3511000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3C3217000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3C3002000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3C2DE5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3C2A3D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3C391E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa3c2a5e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T13:59:49.759+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:00:49.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] MongoDB starting : pid=20926 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:00:49.903+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:00:49.954+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:00:50.309+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903250:309307][20926:0x7fe553263c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:00:50.309+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:00:50.319+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe552193635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE552172000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF31AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE552E4A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE552C46000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE55294C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE552737000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE55251A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE552172000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE553053000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe552193635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:00:50.320+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:01:49.737+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] MongoDB starting : pid=21157 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:01:49.745+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:01:49.795+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:01:50.100+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903310:100638][21157:0x7f0cae844c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:01:50.100+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:01:50.111+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0cad774635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CAD753000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF53CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CAE42B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CAE227000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CADF2D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CADD18000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CADAFB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CAD753000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CAE634000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0cad774635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:01:50.111+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:02:49.912+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] MongoDB starting : pid=21377 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:02:49.919+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:02:49.973+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:02:50.377+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903370:377145][21377:0x7fae69d64c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:02:50.377+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:02:50.397+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fae68c94635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAE68C73000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF322FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAE6994B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAE69747000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAE6944D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAE69238000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAE6901B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAE68C73000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAE69B54000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fae68c94635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:02:50.397+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:03:49.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] MongoDB starting : pid=21544 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:03:50.003+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:03:50.052+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:03:50.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903430:440527][21544:0x7f26111f0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:03:50.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:03:50.460+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2610120635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F26100FF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2610DD7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2610BD3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F26108D9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F26106C4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F26104A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F26100FF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2610FE0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2610120635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:03:50.460+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:04:49.582+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] MongoDB starting : pid=21813 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:04:49.590+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:04:49.640+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:04:49.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903489:963261][21813:0x7f01a2628c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:04:49.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:04:49.975+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f01a1558635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F01A1537000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC6BA4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01A220F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01A200B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01A1D11000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01A1AFC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01A18DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F01A1537000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F01A2418000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f01a1558635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:04:49.975+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:05:49.097+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=22034 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:05:49.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:05:49.156+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:05:49.481+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903549:481309][22034:0x7f0dbea20c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:05:49.481+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:05:49.501+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0dbd950635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0DBD92F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF74387000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0DBE607000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0DBE403000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0DBE109000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0DBDEF4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0DBDCD7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0DBD92F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0DBE810000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0dbd950635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:05:49.501+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:06:49.895+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] MongoDB starting : pid=22258 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:06:49.903+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:06:49.953+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:06:50.239+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903610:239917][22258:0x7fdda089ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:06:50.239+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:06:50.250+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdd9f7ca635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDD9F7A9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDDA0481000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDDA027D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDD9FF83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDD9FD6E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDD9FB51000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDD9F7A9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDDA068A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdd9f7ca635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:06:50.250+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:07:49.380+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] MongoDB starting : pid=22479 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:07:49.388+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:07:49.439+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:07:49.807+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903669:807815][22479:0x7fad49169c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:07:49.807+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:07:49.828+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fad48099635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAD48078000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCD2C7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAD48D50000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAD48B4C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAD48852000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAD4863D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAD48420000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAD48078000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAD48F59000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fad48099635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:07:49.828+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:08:49.838+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] MongoDB starting : pid=22648 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:08:49.845+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:08:49.895+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:08:50.147+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903730:147943][22648:0x7fd1c997ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:08:50.148+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:08:50.158+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd1c88ae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD1C888D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE43D3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD1C9565000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD1C9361000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD1C9067000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD1C8E52000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD1C8C35000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD1C888D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD1C976E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd1c88ae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:08:50.158+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:09:49.287+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] MongoDB starting : pid=22911 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:09:49.295+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:09:49.344+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:09:49.612+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903789:612672][22911:0x7efeff176c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:09:49.612+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:09:49.623+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7efefe0a6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFEFE085000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB22FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFEFED5D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFEFEB59000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFEFE85F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFEFE64A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFEFE42D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFEFE085000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFEFEF66000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7efefe0a6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:09:49.623+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:10:49.749+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] MongoDB starting : pid=23137 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:10:49.757+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:10:49.807+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:10:50.157+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903850:157186][23137:0x7f73424f1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:10:50.157+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:10:50.176+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7341421635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7341400000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE3C96000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F73420D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7341ED4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7341BDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73419C5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73417A8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7341400000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F73422E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7341421635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:10:50.176+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:11:49.639+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] MongoDB starting : pid=23338 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:11:49.646+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:11:49.695+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:11:49.993+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903909:993428][23338:0x7faca1c7ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:11:49.993+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:11:50.013+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faca0bae635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FACA0B8D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD24FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FACA1865000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FACA1661000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FACA1367000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FACA1152000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FACA0F35000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FACA0B8D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FACA1A6E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faca0bae635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:11:50.013+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:12:49.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=23653 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:12:49.150+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:12:49.204+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:12:49.547+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507903969:547635][23653:0x7f53d7617c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:12:49.547+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:12:49.566+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53d6547635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53D6526000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A6B7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53D71FE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53D6FFA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53D6D00000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F53D6AEB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F53D68CE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53D6526000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53D7407000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53d6547635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:12:49.566+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:13:49.304+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:13:49.313+0000 I CONTROL [initandlisten] MongoDB starting : pid=23814 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:13:49.313+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:13:49.313+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:13:49.313+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:13:49.314+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:13:49.314+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:13:49.314+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:13:49.314+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:13:49.314+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:13:49.366+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:13:49.717+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904029:717812][23814:0x7fe4f0472c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:13:49.717+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:13:49.737+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4ef3a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4EF381000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1B6B3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4F0059000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4EFE55000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4EFB5B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4EF946000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4EF729000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4EF381000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4F0262000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4ef3a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:13:49.737+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:14:49.869+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] MongoDB starting : pid=24129 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:14:49.877+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:14:49.926+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:14:50.249+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904090:249918][24129:0x7faa41599c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:14:50.249+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:14:50.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa404c9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA404A8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1D6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA41180000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA40F7C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA40C82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA40A6D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA40850000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA404A8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA41389000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa404c9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:14:50.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:15:49.379+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] MongoDB starting : pid=24363 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:15:49.387+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:15:49.437+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:15:49.738+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904149:738169][24363:0x7f9e410bec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:15:49.738+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:15:49.748+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9e3ffee635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9E3FFCD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFE8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9E40CA5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9E40AA1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9E407A7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9E40592000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9E40375000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9E3FFCD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9E40EAE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9e3ffee635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:15:49.748+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:16:49.183+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:16:49.191+0000 I CONTROL [initandlisten] MongoDB starting : pid=24569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:16:49.192+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:16:49.242+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:16:49.531+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904209:531418][24569:0x7f0ed0dccc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:16:49.531+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:16:49.542+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0ecfcfc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0ECFCDB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5B8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0ED09B3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0ED07AF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0ED04B5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0ED02A0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0ED0083000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0ECFCDB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0ED0BBC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0ecfcfc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:16:49.542+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:17:49.675+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] MongoDB starting : pid=24799 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:17:49.683+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:17:49.733+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:17:50.014+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904270:14444][24799:0x7fc583c78c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:17:50.014+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:17:50.024+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc582ba8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC582B87000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF535CC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC58385F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC58365B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC583361000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC58314C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC582F2F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC582B87000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC583A68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc582ba8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:17:50.025+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:18:49.887+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] MongoDB starting : pid=24948 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:18:49.895+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:18:49.947+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:18:50.274+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904330:274609][24948:0x7fbd97aecc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:18:50.274+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:18:50.285+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbd96a1c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBD969FB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF94FD7000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBD976D3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBD974CF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBD971D5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBD96FC0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBD96DA3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBD969FB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBD978DC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbd96a1c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:18:50.285+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:19:49.422+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] MongoDB starting : pid=25238 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:19:49.433+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:19:49.486+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:19:49.858+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904389:858634][25238:0x7fa9aa12dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:19:49.858+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:19:49.877+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa9a905d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA9A903C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA6697000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9A9D14000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9A9B10000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9A9816000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA9A9601000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA9A93E4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA9A903C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9A9F1D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa9a905d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:19:49.877+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:20:50.002+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] MongoDB starting : pid=25467 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:20:50.010+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:20:50.060+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:20:50.375+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904450:375205][25467:0x7fc17a9a1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:20:50.375+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:20:50.386+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1798d1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1798B0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2B6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC17A588000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC17A384000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC17A08A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC179E75000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC179C58000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1798B0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC17A791000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1798d1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:20:50.386+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:21:49.799+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] MongoDB starting : pid=25669 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:21:49.807+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:21:49.857+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:21:50.186+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904510:186130][25669:0x7f8fc00fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:21:50.186+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:21:50.196+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8fbf02b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8FBF00A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64884000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8FBFCE2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8FBFADE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8FBF7E4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8FBF5CF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8FBF3B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8FBF00A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8FBFEEB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8fbf02b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:21:50.196+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:22:49.328+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] MongoDB starting : pid=25904 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:22:49.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:22:49.386+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:22:49.713+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904569:713948][25904:0x7f149a96ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:22:49.714+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:22:49.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f149989e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F149987D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC0CBE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F149A555000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F149A351000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F149A057000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1499E42000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1499C25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F149987D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F149A75E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f149989e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:22:49.733+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:23:49.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] MongoDB starting : pid=26051 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:23:49.346+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:23:49.396+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:23:49.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904629:667998][26051:0x7f16f09e4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:23:49.668+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:23:49.687+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f16ef914635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F16EF8F3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF552FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F16F05CB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F16F03C7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F16F00CD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F16EFEB8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F16EFC9B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F16EF8F3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F16F07D4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f16ef914635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:23:49.687+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:24:49.828+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] MongoDB starting : pid=26342 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:24:49.836+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:24:49.891+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:24:50.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904690:242500][26342:0x7f4cb372ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:24:50.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:24:50.261+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4cb265a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4CB2639000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4CB3311000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4CB310D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4CB2E13000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4CB2BFE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4CB29E1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4CB2639000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4CB351A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4cb265a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:24:50.261+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:25:49.385+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] MongoDB starting : pid=26571 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:25:49.392+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:25:49.442+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:25:49.708+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904749:708906][26571:0x7fc338ae0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:25:49.708+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:25:49.719+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc337a10635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC3379EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEDB1B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC3386C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3384C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3381C9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC337FB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC337D97000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3379EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3388D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc337a10635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:25:49.719+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:26:49.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] MongoDB starting : pid=26785 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:26:49.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:26:49.209+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:26:49.512+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904809:512800][26785:0x7ffedeb43c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:26:49.512+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:26:49.532+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffedda73635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFEDDA52000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFADAF6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFEDE72A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFEDE526000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFEDE22C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFEDE017000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFEDDDFA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFEDDA52000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFEDE933000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffedda73635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:26:49.532+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:27:49.697+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] MongoDB starting : pid=27012 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:27:49.705+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:27:49.755+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:27:50.117+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904870:117450][27012:0x7f7ea86d4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:27:50.117+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:27:50.138+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ea7604635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7EA75E3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF106A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7EA82BB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7EA80B7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7EA7DBD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7EA7BA8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7EA798B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7EA75E3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7EA84C4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ea7604635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:27:50.138+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:28:49.526+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] MongoDB starting : pid=27167 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:28:49.538+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:28:49.590+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:28:49.890+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904929:890984][27167:0x7fcbaec0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:28:49.891+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:28:49.901+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcbadb3a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCBADB19000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4DC4A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCBAE7F1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCBAE5ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCBAE2F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCBAE0DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCBADEC1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCBADB19000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCBAE9FA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcbadb3a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:28:49.901+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:29:50.035+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] MongoDB starting : pid=27321 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:29:50.043+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:29:50.093+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:29:50.508+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507904990:508563][27321:0x7f948b949c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:29:50.508+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:29:50.528+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f948a879635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F948A858000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF410FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F948B530000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F948B32C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F948B032000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F948AE1D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F948AC00000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F948A858000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F948B739000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f948a879635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:29:50.528+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:30:49.659+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] MongoDB starting : pid=27595 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:30:49.667+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:30:49.716+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:30:50.041+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905050:41849][27595:0x7f1d158aec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:30:50.041+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:30:50.063+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1d147de635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1D147BD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF14FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1D15495000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1D15291000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1D14F97000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1D14D82000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1D14B65000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1D147BD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1D1569E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1d147de635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:30:50.063+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:31:49.507+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] MongoDB starting : pid=27795 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:31:49.515+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:31:49.564+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:31:49.853+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905109:853292][27795:0x7fdb3ad68c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:31:49.853+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:31:49.873+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb39c98635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB39C77000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0CF9F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB3A94F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB3A74B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB3A451000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB3A23C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB3A01F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB39C77000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB3AB58000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb39c98635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:31:49.873+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:32:49.994+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:32:50.001+0000 I CONTROL [initandlisten] MongoDB starting : pid=28030 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:32:50.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:32:50.051+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:32:50.393+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905170:393354][28030:0x7fcdee485c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:32:50.393+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:32:50.412+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcded3b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCDED394000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF73D90000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCDEE06C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCDEDE68000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCDEDB6E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCDED959000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCDED73C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCDED394000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCDEE275000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcded3b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:32:50.412+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:33:49.167+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] MongoDB starting : pid=28252 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:33:49.175+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:33:49.225+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:33:49.516+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905229:516086][28252:0x7f61c7294c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:33:49.516+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:33:49.526+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f61c61c4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F61C61A3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB336F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F61C6E7B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F61C6C77000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F61C697D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61C6768000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F61C654B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F61C61A3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F61C7084000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f61c61c4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:33:49.526+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:34:49.653+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] MongoDB starting : pid=28425 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:34:49.660+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:34:49.711+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:34:50.010+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905290:10234][28425:0x7f7ae8221c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:34:50.010+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:34:50.029+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7ae7151635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7AE7130000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE16FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7AE7E08000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7AE7C04000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7AE790A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7AE76F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7AE74D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7AE7130000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7AE8011000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7ae7151635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:34:50.029+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:35:49.157+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] MongoDB starting : pid=28704 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:35:49.164+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:35:49.226+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:35:49.573+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905349:573910][28704:0x7f34f7942c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:35:49.574+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:35:49.593+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f34f6872635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F34F6851000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF09A50000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F34F7529000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34F7325000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34F702B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F34F6E16000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F34F6BF9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34F6851000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34F7732000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f34f6872635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:35:49.593+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:36:50.026+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] MongoDB starting : pid=28918 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:36:50.034+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:36:50.085+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:36:50.398+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905410:398403][28918:0x7fbc25fd2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:36:50.398+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:36:50.417+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc24f02635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC24EE1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAD2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC25BB9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC259B5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC256BB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC254A6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC25289000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC24EE1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC25DC2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc24f02635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:36:50.417+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:37:49.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] MongoDB starting : pid=29148 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:37:49.558+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:37:49.608+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:37:49.912+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905469:912930][29148:0x7f3cd8b82c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:37:49.912+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:37:49.924+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3cd7ab2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3CD7A91000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA4EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3CD8769000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3CD8565000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3CD826B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3CD8056000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3CD7E39000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3CD7A91000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3CD8972000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3cd7ab2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:37:49.924+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:38:49.528+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] MongoDB starting : pid=29374 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:38:49.535+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:38:49.536+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:38:49.586+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:38:49.955+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905529:955266][29374:0x7f959fcb5c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:38:49.955+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:38:49.966+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f959ebe5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F959EBC4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA64FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F959F89C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F959F698000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F959F39E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F959F189000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F959EF6C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F959EBC4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F959FAA5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f959ebe5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:38:49.966+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:39:49.082+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] MongoDB starting : pid=29536 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:39:49.089+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:39:49.139+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:39:49.409+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905589:409601][29536:0x7f7a9d85cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:39:49.409+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:39:49.420+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7a9c78c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7A9C76B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF515F0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7A9D443000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7A9D23F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7A9CF45000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7A9CD30000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7A9CB13000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7A9C76B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7A9D64C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7a9c78c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:39:49.420+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:40:49.547+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:40:49.554+0000 I CONTROL [initandlisten] MongoDB starting : pid=29819 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:40:49.554+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:40:49.554+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:40:49.554+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:40:49.554+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:40:49.554+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:40:49.555+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:40:49.555+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:40:49.555+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:40:49.609+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:40:49.948+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905649:948374][29819:0x7fc8c5b09c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:40:49.948+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:40:49.959+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8c4a39635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8C4A18000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF160FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8C56F0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8C54EC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8C51F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8C4FDD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8C4DC0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8C4A18000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8C58F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8c4a39635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:40:49.959+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:41:49.434+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:41:49.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=30022 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:41:49.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:41:49.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:41:49.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:41:49.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:41:49.444+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:41:49.444+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:41:49.444+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:41:49.444+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:41:49.494+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:41:49.779+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905709:779988][30022:0x7fefc61b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:41:49.780+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:41:49.790+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fefc50e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEFC50C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4FBCC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEFC5DA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEFC5B9C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEFC58A2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEFC568D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEFC5470000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEFC50C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEFC5FA9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fefc50e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:41:49.790+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:42:49.934+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] MongoDB starting : pid=30270 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:42:49.944+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:42:49.994+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:42:50.378+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905770:378648][30270:0x7f77761eac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:42:50.378+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:42:50.399+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f777511a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F77750F9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0D0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7775DD1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7775BCD000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F77758D3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F77756BE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F77754A1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F77750F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7775FDA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f777511a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:42:50.399+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:43:49.835+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] MongoDB starting : pid=30508 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:43:49.840+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:43:49.868+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:43:50.161+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905830:161610][30508:0x7f60554b6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:43:50.161+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:43:50.173+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f60543e6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F60543C5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF84CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F605509D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6054E99000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6054B9F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F605498A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F605476D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F60543C5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F60552A6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f60543e6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:43:50.173+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:44:49.299+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] MongoDB starting : pid=30678 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:44:49.308+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:44:49.361+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:44:49.701+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905889:701529][30678:0x7f19b3dc6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:44:49.701+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:44:49.720+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f19b2cf6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F19B2CD5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4371000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F19B39AD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19B37A9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19B34AF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19B329A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19B307D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19B2CD5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19B3BB6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f19b2cf6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:44:49.720+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:45:49.850+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] MongoDB starting : pid=30948 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:45:49.857+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:45:49.908+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:45:50.184+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507905950:184775][30948:0x7ffdde6dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:45:50.184+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:45:50.204+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffddd60f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFDDD5EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36045000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFDDE2C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFDDE0C2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFDDDDC8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFDDDBB3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFDDD996000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFDDD5EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFDDE4CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffddd60f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:45:50.204+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:46:49.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=31152 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:46:49.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:46:49.651+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:46:49.933+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906009:933115][31152:0x7fbfe9c42c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:46:49.933+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:46:49.944+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbfe8b74635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBFE8B53000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FBFEA553000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBFE982B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBFE9627000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBFE932D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBFE9118000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBFE8EFB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBFE8B53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBFE9A34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbfe8b74635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:46:49.944+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:47:49.072+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] MongoDB starting : pid=31388 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:47:49.080+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:47:49.131+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:47:49.435+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906069:435454][31388:0x7f05a3725c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:47:49.435+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:47:49.446+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f05a2655635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F05A2634000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDB2FD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F05A330C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F05A3108000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F05A2E0E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F05A2BF9000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F05A29DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F05A2634000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F05A3515000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f05a2655635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:47:49.446+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:48:49.283+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] MongoDB starting : pid=31618 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:48:49.290+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:48:49.340+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:48:49.651+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906129:651543][31618:0x7f18021eec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:48:49.651+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:48:49.667+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f180111e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F18010FD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF804FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1801DD5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1801BD1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F18018D7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F18016C2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F18014A5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F18010FD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1801FDE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f180111e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:48:49.667+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:49:49.795+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] MongoDB starting : pid=31780 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:49:49.803+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:49:49.853+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:49:50.153+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906190:153886][31780:0x7f3bb79b4c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:49:50.153+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:49:50.164+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3bb68e4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F3BB68C3000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0EA72000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F3BB759B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BB7397000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BB709D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BB6E88000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BB6C6B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BB68C3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BB77A4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3bb68e4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:49:50.164+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:50:49.298+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] MongoDB starting : pid=32061 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:50:49.306+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:50:49.355+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:50:49.665+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906249:665702][32061:0x7fbc7327ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:50:49.665+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:50:49.677+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fbc721aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FBC72189000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA029F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FBC72E61000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FBC72C5D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FBC72963000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FBC7274E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FBC72531000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FBC72189000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FBC7306A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fbc721aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:50:49.677+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:51:49.083+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] MongoDB starting : pid=32261 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:51:49.090+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:51:49.140+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:51:49.485+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906309:485739][32261:0x7f656957ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:51:49.485+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:51:49.496+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f65684aa635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6568489000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF100FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6569161000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6568F5D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6568C63000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6568A4E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6568831000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6568489000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F656936A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f65684aa635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:51:49.496+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:52:49.635+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] MongoDB starting : pid=32502 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:52:49.643+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:52:49.693+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:52:49.972+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906369:972728][32502:0x7f9ce4d83c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:52:49.972+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:52:49.983+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9ce3cb3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9CE3C92000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4245B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9CE496A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9CE4766000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9CE446C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9CE4257000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9CE403A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9CE3C92000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9CE4B73000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9ce3cb3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:52:49.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:53:49.791+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] MongoDB starting : pid=32718 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:53:49.799+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:53:49.849+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:53:50.192+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906430:192683][32718:0x7f83b0103c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:53:50.192+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:53:50.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83af033635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83AF012000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCCCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83AFCEA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83AFAE6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83AF7EC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83AF5D7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83AF3BA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83AF012000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83AFEF3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83af033635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:53:50.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:54:49.338+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] MongoDB starting : pid=414 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:54:49.345+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:54:49.395+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:54:49.710+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906489:710002][414:0x7f095f4afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:54:49.710+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:54:49.720+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f095e3df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F095E3BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD487000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F095F096000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F095EE92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F095EB98000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F095E983000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F095E766000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F095E3BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F095F29F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f095e3df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:54:49.720+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:55:49.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=692 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:55:49.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:55:49.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:55:50.276+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906550:276319][692:0x7fda15222c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:55:50.276+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:55:50.296+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fda14152635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDA14131000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF02AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDA14E09000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDA14C05000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDA1490B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDA146F6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDA144D9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDA14131000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDA15012000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fda14152635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:55:50.296+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:56:49.687+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] MongoDB starting : pid=897 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:56:49.695+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:56:49.744+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:56:50.053+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906610:53318][897:0x7f57d2ba2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:56:50.053+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:56:50.073+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f57d1ad2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F57D1AB1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6B4E5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F57D2789000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F57D2585000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F57D228B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F57D2076000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F57D1E59000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F57D1AB1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F57D2992000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f57d1ad2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:56:50.073+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:57:49.199+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=1137 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:57:49.206+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:57:49.256+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:57:49.552+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906669:552038][1137:0x7fac679f3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:57:49.552+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:57:49.562+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fac66923635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAC66902000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C748000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAC675DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAC673D6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAC670DC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAC66EC7000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAC66CAA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAC66902000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAC677E3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fac66923635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:57:49.562+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:58:49.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] MongoDB starting : pid=1363 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:58:49.152+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:58:49.203+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:58:49.502+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906729:502158][1363:0x7fc35726bc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:58:49.502+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:58:49.512+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc35619b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC35617A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF17FAD000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC356E52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC356C4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC356954000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC35673F000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC356522000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC35617A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC35705B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc35619b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:58:49.512+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T14:59:49.634+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] MongoDB starting : pid=1535 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] modules: none 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] build environment: 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T14:59:49.643+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T14:59:49.694+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T14:59:49.991+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906789:991980][1535:0x7f406f897c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T14:59:49.992+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T14:59:50.010+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f406e7c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F406E7A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF39AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F406F47E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F406F27A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F406EF80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F406ED6B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F406EB4E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F406E7A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F406F687000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f406e7c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T14:59:50.010+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:00:49.142+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:00:49.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=1805 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:00:49.150+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:00:49.150+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:00:49.150+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:00:49.150+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:00:49.151+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:00:49.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:00:49.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:00:49.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:00:49.201+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:00:49.577+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906849:577803][1805:0x7fc9b77c2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:00:49.577+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:00:49.588+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc9b66f2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC9B66D1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF972FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC9B73A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC9B71A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC9B6EAB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC9B6C96000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC9B6A79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC9B66D1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC9B75B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc9b66f2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:00:49.588+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:01:50.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] MongoDB starting : pid=2012 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:01:50.012+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:01:50.062+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:01:50.332+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906910:332015][2012:0x7ff5984d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:01:50.332+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:01:50.342+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff597406635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF5973E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8A4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF5980BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF597EB9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF597BBF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF5979AA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF59778D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF5973E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF5982C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff597406635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:01:50.342+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:02:49.753+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] MongoDB starting : pid=2237 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:02:49.760+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:02:49.810+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:02:50.095+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507906970:95927][2237:0x7ff459e6dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:02:50.095+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:02:50.106+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff458d9d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF458D7C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF750FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF459A54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF459850000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF459556000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF459341000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF459124000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF458D7C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF459C5D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff458d9d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:02:50.106+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:03:49.567+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] MongoDB starting : pid=2373 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:03:49.575+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:03:49.625+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:03:49.965+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907029:965153][2373:0x7fe87f786c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:03:49.965+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:03:49.984+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe87e6b6635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE87E695000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE52FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE87F36D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE87F169000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE87EE6F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE87EC5A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE87EA3D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE87E695000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE87F576000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe87e6b6635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:03:49.984+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:04:49.107+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] MongoDB starting : pid=2626 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:04:49.114+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:04:49.165+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:04:49.440+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907089:440522][2626:0x7f1b0afa0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:04:49.440+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:04:49.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b09ed0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B09EAF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA3581000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B0AB87000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B0A983000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B0A689000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B0A474000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B0A257000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B09EAF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B0AD90000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b09ed0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:04:49.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:05:49.570+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] MongoDB starting : pid=2759 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:05:49.577+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:05:49.626+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:05:49.919+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907149:919274][2759:0x7f2f37882c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:05:49.919+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:05:49.932+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2f367b2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2F36791000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF51CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2F37469000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2F37265000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2F36F6B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2F36D56000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2F36B39000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2F36791000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2F37672000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2f367b2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:05:49.932+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:06:49.374+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] MongoDB starting : pid=3028 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:06:49.381+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:06:49.431+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:06:49.820+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907209:820088][3028:0x7f7826e8cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:06:49.820+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:06:49.839+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7825dbc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7825D9B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF49EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7826A73000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F782686F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7826575000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7826360000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7826143000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7825D9B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7826C7C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7825dbc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:06:49.839+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:07:49.977+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] MongoDB starting : pid=3261 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:07:49.984+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:07:50.035+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:07:50.413+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907270:413913][3261:0x7f9a15891c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:07:50.414+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:07:50.433+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a147c1635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A147A0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A15478000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A15274000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A14F7A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A14D65000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A14B48000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A147A0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A15681000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a147c1635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:07:50.433+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:08:49.843+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] MongoDB starting : pid=3484 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:08:49.850+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:08:49.902+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:08:50.180+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907330:180322][3484:0x7fdfb1a72c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:08:50.180+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:08:50.200+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdfb09a2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFB0981000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF99EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFB1659000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFB1455000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFB115B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFB0F46000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFB0D29000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFB0981000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFB1862000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdfb09a2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:08:50.200+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:09:49.327+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:09:49.334+0000 I CONTROL [initandlisten] MongoDB starting : pid=3733 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:09:49.335+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:09:49.384+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:09:49.682+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907389:682300][3733:0x7fd7afa5ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:09:49.682+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:09:49.693+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd7ae98a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD7AE969000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF35E2F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD7AF641000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD7AF43D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD7AF143000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD7AEF2E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD7AED11000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD7AE969000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD7AF84A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd7ae98a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:09:49.693+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:10:49.826+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] MongoDB starting : pid=3860 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:10:49.833+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:10:49.883+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:10:50.188+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907450:188945][3860:0x7fb6fbcdbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:10:50.189+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:10:50.208+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb6fac0b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB6FABEA000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0FA53000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB6FB8C2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB6FB6BE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB6FB3C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB6FB1AF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB6FAF92000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB6FABEA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB6FBACB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb6fac0b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:10:50.208+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:11:49.614+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:11:49.622+0000 I CONTROL [initandlisten] MongoDB starting : pid=4131 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:11:49.622+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:11:49.623+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:11:49.673+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:11:50.026+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907510:26371][4131:0x7fa0c41e7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:11:50.026+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:11:50.037+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa0c3117635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA0C30F6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF20FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA0C3DCE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA0C3BCA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA0C38D0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA0C36BB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA0C349E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA0C30F6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA0C3FD7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa0c3117635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:11:50.037+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:12:49.170+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] MongoDB starting : pid=4372 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:12:49.178+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:12:49.229+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:12:49.582+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907569:582174][4372:0x7f77d588cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:12:49.582+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:12:49.602+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f77d47bc635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F77D479B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD4408000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F77D5473000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F77D526F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F77D4F75000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F77D4D60000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F77D4B43000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F77D479B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F77D567C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f77d47bc635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:12:49.602+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:13:49.178+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:13:49.185+0000 I CONTROL [initandlisten] MongoDB starting : pid=4586 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:13:49.185+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:13:49.186+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:13:49.238+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:13:49.626+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907629:625994][4586:0x7f1bde109c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:13:49.626+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:13:49.645+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1bdd039635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1BDD018000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC6FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1BDDCF0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1BDDAEC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1BDD7F2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1BDD5DD000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1BDD3C0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1BDD018000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1BDDEF9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1bdd039635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:13:49.645+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:14:49.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] MongoDB starting : pid=4864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:14:49.794+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:14:49.844+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:14:50.159+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907690:159594][4864:0x7effe4e30c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:14:50.159+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:14:50.179+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7effe3d60635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFE3D3F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAB0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFE4A17000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFE4813000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFE4519000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFE4304000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFE40E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFE3D3F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFE4C20000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7effe3d60635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:14:50.179+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:15:49.305+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] MongoDB starting : pid=5015 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:15:49.312+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:15:49.362+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:15:49.633+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907749:633777][5015:0x7fe078774c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:15:49.633+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:15:49.644+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe0776a4635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE077683000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF10AC1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE07835B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE078157000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE077E5D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE077C48000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE077A2B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE077683000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE078564000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe0776a4635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:15:49.644+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:16:50.018+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] MongoDB starting : pid=5543 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:16:50.025+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:16:50.026+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:16:50.077+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:16:50.431+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907810:430992][5543:0x7f603e50ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:16:50.431+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:16:50.451+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f603d43e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F603D41D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3A85E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F603E0F5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F603DEF1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F603DBF7000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F603D9E2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F603D7C5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F603D41D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F603E2FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f603d43e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:16:50.451+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:17:49.576+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] MongoDB starting : pid=5930 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:17:49.583+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:17:49.634+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:17:50.082+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907870:82704][5930:0x7f9689a80c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:17:50.082+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:17:50.105+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f96889b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F968898F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF245A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9689667000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9689463000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9689169000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9688F54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9688D37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F968898F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9689870000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f96889b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:17:50.105+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:18:49.451+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=6271 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:18:49.460+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:18:49.512+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:18:49.847+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907929:847499][6271:0x7f93a782dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:18:49.847+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:18:49.866+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f93a675d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F93A673C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFF4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F93A7414000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F93A7210000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F93A6F16000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F93A6D01000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F93A6AE4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F93A673C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F93A761D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f93a675d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:18:49.866+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:19:49.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=6605 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:19:50.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:19:50.053+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:19:50.396+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507907990:396782][6605:0x7f83a16b9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:19:50.396+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:19:50.407+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f83a05e9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F83A05C8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF20232000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F83A12A0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F83A109C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F83A0DA2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F83A0B8D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F83A0970000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F83A05C8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F83A14A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f83a05e9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:19:50.407+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:20:49.539+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] MongoDB starting : pid=6754 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:20:49.546+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:20:49.597+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:20:49.946+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908049:946394][6754:0x7f2e721c3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:20:49.946+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:20:49.970+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f2e710f3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F2E710D2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCC429000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F2E71DAA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2E71BA6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2E718AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2E71697000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2E7147A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2E710D2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2E71FB3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f2e710f3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:20:49.970+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:21:49.391+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] MongoDB starting : pid=7030 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:21:49.398+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:21:49.449+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:21:49.723+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908109:723437][7030:0x7fb80cfa2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:21:49.723+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:21:49.733+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb80bed2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB80BEB1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06DF2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB80CB89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB80C985000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB80C68B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB80C476000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB80C259000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB80BEB1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB80CD92000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb80bed2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:21:49.734+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:22:49.874+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] MongoDB starting : pid=7274 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:22:49.881+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:22:49.931+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:22:50.294+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908170:294343][7274:0x7f648d766c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:22:50.294+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:22:50.313+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f648c696635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F648C675000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85048000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F648D34D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F648D149000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F648CE4F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F648CC3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F648CA1D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F648C675000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F648D556000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f648c696635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:22:50.313+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:23:49.440+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] MongoDB starting : pid=7481 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:23:49.448+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:23:49.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:23:49.863+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908229:863506][7481:0x7ff04a5d6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:23:49.863+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:23:49.874+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff049506635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF0494E5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5C2A0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF04A1BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF049FB9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF049CBF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF049AAA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF04988D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF0494E5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF04A3C6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff049506635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:23:49.874+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:24:49.212+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] MongoDB starting : pid=7739 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:24:49.219+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:24:49.268+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:24:49.512+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908289:512017][7739:0x7fa4f9f65c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:24:49.512+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:24:49.522+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa4f8e95635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA4F8E74000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3DEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA4F9B4C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA4F9948000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA4F964E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA4F9439000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA4F921C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA4F8E74000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA4F9D55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa4f8e95635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:24:49.522+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:25:49.658+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] MongoDB starting : pid=7864 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:25:49.665+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:25:49.715+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:25:49.984+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908349:984966][7864:0x7fa932764c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:25:49.985+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:25:49.995+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa931694635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA931673000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA93234B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA932147000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA931E4D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA931C38000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA931A1B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA931673000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA932554000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa931694635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:25:49.995+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:26:49.378+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] MongoDB starting : pid=8144 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:26:49.385+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:26:49.435+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:26:49.751+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908409:751948][8144:0x7f4df2469c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:26:49.752+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:26:49.771+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4df1399635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4DF1378000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF958FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4DF2050000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4DF1E4C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4DF1B52000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4DF193D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4DF1720000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4DF1378000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4DF2259000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4df1399635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:26:49.771+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:27:49.898+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] MongoDB starting : pid=8376 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:27:49.906+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:27:49.957+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:27:50.344+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908470:344821][8376:0x7f8b1091dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:27:50.344+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:27:50.364+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8b0f84d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8B0F82C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF70C38000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8B10504000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8B10300000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8B10006000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8B0FDF1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8B0FBD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8B0F82C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8B1070D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8b0f84d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:27:50.364+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:28:49.492+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] MongoDB starting : pid=8617 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:28:49.499+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:28:49.550+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:28:49.844+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908529:844086][8617:0x7f09ab47cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:28:49.844+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:28:49.855+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f09aa3ac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F09AA38B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4204A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F09AB063000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F09AAE5F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F09AAB65000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F09AA950000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F09AA733000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F09AA38B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F09AB26C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f09aa3ac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:28:49.855+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:29:49.758+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] MongoDB starting : pid=8870 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:29:49.765+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:29:49.815+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:29:50.100+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908590:100462][8870:0x7f0d3f595c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:29:50.100+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:29:50.111+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d3e4c5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D3E4A4000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24015000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D3F17C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D3EF78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D3EC7E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D3EA69000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D3E84C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D3E4A4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D3F385000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d3e4c5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:29:50.111+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:30:49.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=9007 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:30:49.249+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:30:49.315+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:30:49.668+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908649:668950][9007:0x7f5306759c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:30:49.669+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:30:49.679+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5305689635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5305668000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF902FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5306340000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F530613C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5305E42000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5305C2D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5305A10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5305668000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5306549000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5305689635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:30:49.679+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:31:49.102+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] MongoDB starting : pid=9293 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:31:49.111+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:31:49.166+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:31:49.500+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908709:500506][9293:0x7f74097fbc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:31:49.500+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:31:49.519+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f740872b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F740870A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD96EF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F74093E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F74091DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7408EE4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7408CCF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7408AB2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F740870A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F74095EB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f740872b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:31:49.519+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:32:49.640+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] MongoDB starting : pid=9537 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:32:49.647+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:32:49.648+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:32:49.648+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:32:49.698+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:32:50.073+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908770:73756][9537:0x7fa765f0ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:32:50.073+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:32:50.094+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa764e3a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA764E19000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9969F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA765AF1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA7658ED000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA7655F3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA7653DE000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA7651C1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA764E19000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA765CFA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa764e3a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:32:50.094+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:33:49.220+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] MongoDB starting : pid=9743 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:33:49.227+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:33:49.277+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:33:49.672+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908829:672537][9743:0x7f53f8666c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:33:49.672+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:33:49.692+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f53f7596635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F53F7575000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD40E6000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F53F824D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F53F8049000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F53F7D4F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F53F7B3A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F53F791D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F53F7575000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F53F8456000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f53f7596635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:33:49.692+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:34:50.007+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] MongoDB starting : pid=10139 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:34:50.015+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:34:50.065+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:34:50.421+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908890:421342][10139:0x7faeb8319c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:34:50.421+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:34:50.431+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faeb7249635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAEB7228000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8FCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAEB7F00000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAEB7CFC000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAEB7A02000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAEB77ED000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAEB75D0000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAEB7228000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAEB8109000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faeb7249635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:34:50.431+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:35:49.556+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] MongoDB starting : pid=10273 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:35:49.563+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:35:49.613+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:35:49.874+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507908949:874206][10273:0x7f6f0b1afc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:35:49.874+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:35:49.884+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6f0a0df635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6F0A0BE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5F8B2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6F0AD96000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6F0AB92000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6F0A898000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6F0A683000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6F0A466000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6F0A0BE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6F0AF9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6f0a0df635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:35:49.884+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:36:49.284+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] MongoDB starting : pid=10692 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:36:49.292+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:36:49.346+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:36:49.721+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909009:721262][10692:0x7ff69c767c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:36:49.721+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:36:49.740+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff69b697635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF69B676000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC7EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF69C34E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF69C14A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF69BE50000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF69BC3B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF69BA1E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF69B676000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF69C557000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff69b697635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:36:49.740+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:37:49.866+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] MongoDB starting : pid=10947 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:37:49.874+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:37:49.924+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:37:50.216+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909070:216498][10947:0x7f627ee04c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:37:50.216+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:37:50.227+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f627dd34635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F627DD13000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5A688000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F627E9EB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F627E7E7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F627E4ED000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F627E2D8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F627E0BB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F627DD13000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F627EBF4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f627dd34635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:37:50.227+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:38:49.356+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] MongoDB starting : pid=11155 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:38:49.363+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:38:49.412+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:38:49.670+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909129:670413][11155:0x7fecf3e67c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:38:49.670+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:38:49.680+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fecf2d97635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FECF2D76000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF694FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FECF3A4E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FECF384A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FECF3550000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FECF333B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FECF311E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FECF2D76000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FECF3C57000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fecf2d97635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:38:49.680+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:39:49.123+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] MongoDB starting : pid=11398 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:39:49.130+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:39:49.180+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:39:49.490+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909189:490479][11398:0x7f9b3d612c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:39:49.490+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:39:49.502+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9b3c542635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9B3C521000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9B3D1F9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9B3CFF5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9B3CCFB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9B3CAE6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9B3C8C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9B3C521000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9B3D402000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9b3c542635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:39:49.502+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:40:49.633+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:40:49.639+0000 I CONTROL [initandlisten] MongoDB starting : pid=11647 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:40:49.639+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:40:49.640+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:40:49.690+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:40:50.059+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909250:59478][11647:0x7f1fe8c59c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:40:50.059+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:40:50.078+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1fe7b89635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1FE7B68000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF510FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1FE8840000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1FE863C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1FE8342000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1FE812D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1FE7F10000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1FE7B68000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1FE8A49000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1fe7b89635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:40:50.079+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:41:49.550+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] MongoDB starting : pid=11777 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:41:49.557+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:41:49.608+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:41:49.955+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909309:955837][11777:0x7fa6bba8fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:41:49.955+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:41:49.975+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6ba9bf635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6BA99E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF63488000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6BB676000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6BB472000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6BB178000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6BAF63000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6BAD46000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6BA99E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6BB87F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6ba9bf635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:41:49.975+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:42:49.106+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] MongoDB starting : pid=12069 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:42:49.117+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:42:49.171+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:42:49.429+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909369:429928][12069:0x7f0407701c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:42:49.429+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:42:49.441+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0406631635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0406610000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F04072E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F04070E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0406DEA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0406BD5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F04069B8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0406610000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F04074F1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0406631635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:42:49.441+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:43:49.570+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] MongoDB starting : pid=12284 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:43:49.578+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:43:49.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:43:49.911+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909429:911944][12284:0x7eff77730c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:43:49.912+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:43:49.931+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff76660635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF7663F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6D4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF77317000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF77113000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF76E19000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF76C04000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF769E7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF7663F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF77520000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff76660635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:43:49.931+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:44:49.643+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] MongoDB starting : pid=12540 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:44:49.652+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:44:49.706+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:44:50.009+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909490:9854][12540:0x7fcd8ab37c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:44:50.009+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:44:50.020+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcd89a67635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCD89A46000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF65E9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCD8A71E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCD8A51A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCD8A220000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCD8A00B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCD89DEE000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCD89A46000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCD8A927000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcd89a67635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:44:50.020+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:45:49.151+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:45:49.158+0000 I CONTROL [initandlisten] MongoDB starting : pid=12753 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:45:49.158+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:45:49.159+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:45:49.208+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:45:49.496+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909549:496687][12753:0x7f360a450c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:45:49.496+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:45:49.507+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3609380635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F360935F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9A227000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F360A037000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3609E33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3609B39000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3609924000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3609707000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F360935F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F360A240000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3609380635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:45:49.507+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:46:49.906+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=12892 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:46:49.913+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:46:49.963+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:46:50.327+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909610:327665][12892:0x7fed4e0edc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:46:50.327+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:46:50.347+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fed4d01d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FED4CFFC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB7CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FED4DCD4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FED4DAD0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FED4D7D6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FED4D5C1000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FED4D3A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FED4CFFC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FED4DEDD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fed4d01d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:46:50.347+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:47:49.464+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] MongoDB starting : pid=13172 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:47:49.472+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:47:49.523+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:47:49.888+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909669:888603][13172:0x7faa377e6c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:47:49.888+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:47:49.908+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faa36716635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAA366F5000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4CC99000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAA373CD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAA371C9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAA36ECF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAA36CBA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAA36A9D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAA366F5000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAA375D6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faa36716635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:47:49.908+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:48:50.049+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] MongoDB starting : pid=13384 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:48:50.060+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:48:50.116+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:48:50.511+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909730:511637][13384:0x7efff2e62c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:48:50.511+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:48:50.530+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7efff1d92635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFFF1D71000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC38FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFFF2A49000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFFF2845000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFFF254B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFFF2336000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFFF2119000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFFF1D71000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFFF2C52000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7efff1d92635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:48:50.530+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:49:49.890+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] MongoDB starting : pid=13627 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:49:49.898+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:49:49.950+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:49:50.300+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909790:300480][13627:0x7fdfd4792c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:49:50.300+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:49:50.311+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdfd36c2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDFD36A1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2CA38000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDFD4379000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFD4175000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFD3E7B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFD3C66000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFD3A49000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFD36A1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFD4582000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdfd36c2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:49:50.311+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:50:49.439+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] MongoDB starting : pid=13843 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:50:49.450+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:50:49.503+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:50:49.760+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909849:760398][13843:0x7fa8b8ce1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:50:49.760+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:50:49.771+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa8b7c11635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA8B7BF0000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0EAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA8B88C8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA8B86C4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA8B83CA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA8B81B5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA8B7F98000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA8B7BF0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA8B8AD1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa8b7c11635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:50:49.771+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:51:49.179+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] MongoDB starting : pid=13981 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:51:49.187+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:51:49.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:51:49.625+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909909:625464][13981:0x7fdccd578c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:51:49.625+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:51:49.645+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdccc4a8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDCCC487000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5D390000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCCD15F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCCCF5B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDCCCC61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDCCCA4C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDCCC82F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDCCC487000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCCD368000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdccc4a8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:51:49.645+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:52:49.779+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] MongoDB starting : pid=14266 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:52:49.789+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:52:49.846+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:52:50.221+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507909970:221176][14266:0x7fa455051c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:52:50.221+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:52:50.241+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa453f81635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA453F60000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA454C38000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA454A34000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA45473A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA454525000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA454308000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA453F60000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA454E41000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa453f81635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:52:50.241+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:53:49.367+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] MongoDB starting : pid=14738 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:53:49.374+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:53:49.426+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:53:49.736+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910029:736607][14738:0x7fdc22144c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:53:49.736+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:53:49.747+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc21074635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC21053000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF7ACE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDC21D2B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDC21B27000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC2182D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC21618000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC213FB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC21053000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDC21F34000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc21074635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:53:49.747+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:54:49.441+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] MongoDB starting : pid=15083 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:54:49.449+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:54:49.498+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:54:49.761+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910089:761729][15083:0x7fa915bc2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:54:49.761+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:54:49.772+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa914af2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA914AD1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB73F5000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA9157A9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA9155A5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA9152AB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA915096000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA914E79000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA914AD1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA9159B2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa914af2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:54:49.772+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:55:49.903+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:55:49.910+0000 I CONTROL [initandlisten] MongoDB starting : pid=15294 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:55:49.911+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:55:49.961+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:55:50.306+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910150:306693][15294:0x7fe4ade53c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:55:50.306+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:55:50.317+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe4acd83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE4ACD62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF248EA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE4ADA3A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE4AD836000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE4AD53C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE4AD327000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE4AD10A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE4ACD62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE4ADC43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe4acd83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:55:50.317+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:56:49.750+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] MongoDB starting : pid=15442 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:56:49.758+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:56:49.811+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:56:50.050+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910210:50503][15442:0x7fc1f03f2c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:56:50.050+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:56:50.062+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc1ef322635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC1EF301000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF172FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC1EFFD9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC1EFDD5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC1EFADB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC1EF8C6000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC1EF6A9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC1EF301000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC1F01E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc1ef322635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:56:50.062+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:57:49.189+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] MongoDB starting : pid=15743 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:57:49.198+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:57:49.252+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:57:49.633+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910269:633769][15743:0x7f01a8488c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:57:49.633+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:57:49.657+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f01a73b8635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F01A7397000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF61820000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F01A806F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F01A7E6B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F01A7B71000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F01A795C000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F01A773F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F01A7397000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F01A8278000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f01a73b8635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:57:49.657+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:58:49.787+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] MongoDB starting : pid=15965 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:58:49.795+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:58:49.847+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:58:50.241+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910330:241808][15965:0x7fc4df2a7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:58:50.241+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:58:50.261+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4de1d7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4DE1B6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF890D0000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4DEE8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4DEC8A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4DE990000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4DE77B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4DE55E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4DE1B6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4DF097000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4de1d7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:58:50.261+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T15:59:49.753+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] MongoDB starting : pid=16234 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] modules: none 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] build environment: 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T15:59:49.761+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T15:59:49.762+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T15:59:49.812+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T15:59:50.145+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910390:145570][16234:0x7fa0116e8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T15:59:50.145+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T15:59:50.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa010618635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA0105F7000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF020F9000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA0112CF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA0110CB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA010DD1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA010BBC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA01099F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA0105F7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA0114D8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa010618635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T15:59:50.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:00:49.276+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] MongoDB starting : pid=16497 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:00:49.283+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:00:49.284+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:00:49.334+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:00:49.640+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910449:640889][16497:0x7ffd52b46c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:00:49.640+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:00:49.651+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ffd51a76635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FFD51A55000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA54CB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FFD5272D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFD52529000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFD5222F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFD5201A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFD51DFD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFD51A55000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFD52936000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ffd51a76635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:00:49.651+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:01:49.078+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] MongoDB starting : pid=16685 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:01:49.085+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:01:49.135+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:01:49.463+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910509:463469][16685:0x7f0cdf06fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:01:49.463+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:01:49.474+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0cddf9f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0CDDF7E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7B09C000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0CDEC56000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0CDEA52000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0CDE758000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0CDE543000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0CDE326000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0CDDF7E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0CDEE5F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0cddf9f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:01:49.474+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:02:49.285+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] MongoDB starting : pid=17305 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:02:49.292+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:02:49.342+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:02:49.604+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910569:604412][17305:0x7f73db4dfc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:02:49.604+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:02:49.614+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f73da40f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F73DA3EE000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5CAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F73DB0C6000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F73DAEC2000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F73DABC8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F73DA9B3000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F73DA796000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F73DA3EE000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F73DB2CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f73da40f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:02:49.615+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:03:49.743+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] MongoDB starting : pid=17729 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:03:49.750+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:03:49.802+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:03:50.136+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910630:136264][17729:0x7f628a44ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:03:50.136+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:03:50.156+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f628937e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F628935D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD18FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F628A035000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6289E31000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6289B37000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6289922000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6289705000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F628935D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F628A23E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f628937e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:03:50.156+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:04:49.062+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] MongoDB starting : pid=18036 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:04:49.070+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:04:49.121+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:04:49.410+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910689:410877][18036:0x7f34096e0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:04:49.410+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:04:49.430+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f3408610635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F34085EF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7C4FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F34092C7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34090C3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3408DC9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3408BB4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3408997000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34085EF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F34094D0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f3408610635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:04:49.430+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:05:49.557+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] MongoDB starting : pid=18336 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:05:49.564+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:05:49.614+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:05:49.873+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910749:873730][18336:0x7f27a6000c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:05:49.873+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:05:49.885+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f27a4f30635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F27A4F0F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F27A5BE7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F27A59E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F27A56E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F27A54D4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F27A52B7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F27A4F0F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F27A5DF0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f27a4f30635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:05:49.885+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:06:49.331+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] MongoDB starting : pid=18559 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:06:49.339+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:06:49.391+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:06:49.716+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910809:716099][18559:0x7fdca07b0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:06:49.716+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:06:49.726+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdc9f6e0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDC9F6BF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF6D5F000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDCA0397000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDCA0193000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDC9FE99000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDC9FC84000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDC9FA67000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDC9F6BF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDCA05A0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdc9f6e0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:06:49.726+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:07:49.860+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] MongoDB starting : pid=18906 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:07:49.867+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:07:49.920+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:07:50.242+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910870:242590][18906:0x7fd8393c7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:07:50.242+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:07:50.262+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fd8382f7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FD8382D6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FD838FAE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD838DAA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD838AB0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD83889B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD83867E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8382D6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8391B7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fd8382f7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:07:50.262+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:08:49.382+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] MongoDB starting : pid=19122 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:08:49.390+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:08:49.440+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:08:49.787+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910929:787886][19122:0x7fca0370cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:08:49.787+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:08:49.808+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fca0263c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCA0261B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF08AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCA032F3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCA030EF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCA02DF5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCA02BE0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCA029C3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCA0261B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCA034FC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fca0263c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:08:49.808+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:09:49.143+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:09:49.150+0000 I CONTROL [initandlisten] MongoDB starting : pid=19695 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:09:49.151+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:09:49.201+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:09:49.562+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507910989:562137][19695:0x7f1b04121c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:09:49.562+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:09:49.583+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b03051635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B03030000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B03D08000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B03B04000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B0380A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B035F5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B033D8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B03030000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B03F11000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b03051635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:09:49.583+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:10:49.479+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] MongoDB starting : pid=20066 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:10:49.486+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:10:49.536+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:10:49.816+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911049:816476][20066:0x7fcac6377c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:10:49.816+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:10:49.836+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcac52a7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCAC5286000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF588FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCAC5F5E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCAC5D5A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCAC5A60000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCAC584B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCAC562E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCAC5286000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCAC6167000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcac52a7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:10:49.836+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:11:49.236+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] MongoDB starting : pid=20361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:11:49.244+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:11:49.296+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:11:49.613+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911109:613061][20361:0x7f40ec5dcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:11:49.613+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:11:49.623+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f40eb50c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F40EB4EB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF30CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F40EC1C3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F40EBFBF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F40EBCC5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F40EBAB0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F40EB893000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F40EB4EB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F40EC3CC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f40eb50c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:11:49.623+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:12:49.746+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] MongoDB starting : pid=20859 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:12:49.753+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:12:49.803+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:12:50.107+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911170:107566][20859:0x7f0d5d653c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:12:50.107+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:12:50.118+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d5c583635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D5C562000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF400AF000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D5D23A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D5D036000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D5CD3C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D5CB27000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D5C90A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D5C562000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D5D443000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d5c583635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:12:50.118+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:13:49.242+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] MongoDB starting : pid=21144 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:13:49.249+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:13:49.250+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:13:49.301+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:13:49.674+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911229:674747][21144:0x7faf4184ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:13:49.674+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:13:49.685+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7faf4077e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FAF4075D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF116FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FAF41435000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAF41231000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAF40F37000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAF40D22000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAF40B05000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAF4075D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAF4163E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7faf4077e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:13:49.685+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:14:49.707+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=21408 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:14:49.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:14:49.764+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:14:50.058+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911290:58340][21408:0x7f941d37cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:14:50.058+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:14:50.068+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f941c2ac635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F941C28B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF11EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F941CF63000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F941CD5F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F941CA65000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F941C850000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F941C633000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F941C28B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F941D16C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f941c2ac635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:14:50.068+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:15:49.194+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] MongoDB starting : pid=21634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:15:49.201+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:15:49.255+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:15:49.622+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911349:622308][21634:0x7fa3f4624c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:15:49.622+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:15:49.642+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa3f3554635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA3F3533000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E941000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA3F420B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3F4007000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3F3D0D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3F3AF8000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3F38DB000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3F3533000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3F4414000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa3f3554635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:15:49.642+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:16:49.067+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] MongoDB starting : pid=21870 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:16:49.074+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:16:49.126+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:16:49.434+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911409:434006][21870:0x7f4da3ebac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:16:49.434+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:16:49.445+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4da2dea635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4DA2DC9000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4DA3AA1000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4DA389D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4DA35A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4DA338E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4DA3171000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4DA2DC9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4DA3CAA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4da2dea635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:16:49.445+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:17:49.571+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] MongoDB starting : pid=22150 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:17:49.579+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:17:49.629+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:17:49.930+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911469:930490][22150:0x7f80799b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:17:49.930+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:17:49.941+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f80788e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F80788C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7BAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F807959A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8079396000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F807909C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8078E87000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8078C6A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F80788C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F80797A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f80788e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:17:49.941+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:18:49.062+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] MongoDB starting : pid=22331 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:18:49.070+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:18:49.119+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:18:49.425+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911529:425027][22331:0x7fc7cfd87c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:18:49.425+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:18:49.436+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc7cecb7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC7CEC96000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCBE44000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC7CF96E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC7CF76A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC7CF470000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC7CF25B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC7CF03E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC7CEC96000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC7CFB77000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc7cecb7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:18:49.436+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:19:49.235+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] MongoDB starting : pid=22619 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:19:49.243+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:19:49.293+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:19:49.590+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911589:590040][22619:0x7fa6c8d92c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:19:49.590+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:19:49.600+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fa6c7cc2635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FA6C7CA1000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5BCFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FA6C8979000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6C8775000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6C847B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6C8266000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6C8049000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6C7CA1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6C8B82000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fa6c7cc2635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:19:49.601+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:20:49.738+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] MongoDB starting : pid=22873 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:20:49.745+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:20:49.795+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:20:50.131+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911650:131552][22873:0x7f7db2980c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:20:50.131+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:20:50.142+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7db18b0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7DB188F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7F8FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7DB2567000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7DB2363000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7DB2069000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7DB1E54000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7DB1C37000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7DB188F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7DB2770000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7db18b0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:20:50.142+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:21:49.594+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] MongoDB starting : pid=23135 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:21:49.602+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:21:49.652+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:21:49.992+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911709:992463][23135:0x7f5ce2908c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:21:49.992+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:21:50.003+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f5ce1838635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F5CE1817000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF218FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F5CE24EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5CE22EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5CE1FF1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5CE1DDC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5CE1BBF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5CE1817000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5CE26F8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f5ce1838635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:21:50.003+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:22:49.125+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] MongoDB starting : pid=23309 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:22:49.132+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:22:49.182+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:22:49.570+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911769:570727][23309:0x7f7aeb28dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:22:49.570+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:22:49.590+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f7aea1bd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F7AEA19C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFF15E8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F7AEAE74000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F7AEAC70000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F7AEA976000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F7AEA761000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F7AEA544000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F7AEA19C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F7AEB07D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f7aea1bd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:22:49.590+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:23:49.718+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] MongoDB starting : pid=23634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:23:49.726+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:23:49.779+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:23:50.131+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911830:131658][23634:0x7f202f51ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:23:50.131+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:23:50.151+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f202e44e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F202E42D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2362A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F202F105000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F202EF01000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F202EC07000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F202E9F2000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F202E7D5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F202E42D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F202F30E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f202e44e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:23:50.151+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:24:49.556+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] MongoDB starting : pid=23925 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:24:49.563+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:24:49.612+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:24:49.982+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911889:982797][23925:0x7ff9466b3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:24:49.982+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:24:49.993+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7ff9455e3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FF9455C2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE468B000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FF94629A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF946096000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF945D9C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF945B87000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF94596A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF9455C2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF9464A3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7ff9455e3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:24:49.993+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:25:49.123+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] MongoDB starting : pid=24305 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:25:49.130+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:25:49.180+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:25:49.461+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507911949:461221][24305:0x7fb1a3a90c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:25:49.461+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:25:49.471+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fb1a29c0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FB1A299F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF061B1000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FB1A3677000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB1A3473000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB1A3179000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB1A2F64000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1A2D47000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB1A299F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB1A3880000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fb1a29c0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:25:49.472+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:26:49.856+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] MongoDB starting : pid=24634 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:26:49.863+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:26:49.916+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:26:50.202+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912010:202532][24634:0x7fee7399dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:26:50.202+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:26:50.213+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fee728cd635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEE728AC000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF341C4000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEE73584000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEE73380000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEE73086000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEE72E71000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEE72C54000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEE728AC000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEE7378D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fee728cd635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:26:50.213+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:27:49.349+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] MongoDB starting : pid=25023 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:27:49.357+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:27:49.408+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:27:49.728+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912069:728621][25023:0x7f1b441d7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:27:49.728+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:27:49.739+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b43107635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B430E6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA36FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B43DBE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B43BBA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B438C0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B436AB000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B4348E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B430E6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B43FC7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b43107635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:27:49.739+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:28:49.867+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] MongoDB starting : pid=25319 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:28:49.874+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:28:49.875+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:28:49.875+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:28:49.926+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:28:50.260+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912130:260590][25319:0x7fc69b86ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:28:50.260+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:28:50.271+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc69a79e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC69A77D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4E0FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC69B455000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC69B251000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC69AF57000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC69AD42000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC69AB25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC69A77D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC69B65E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc69a79e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:28:50.271+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:29:50.031+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] MongoDB starting : pid=25582 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:29:50.039+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:29:50.090+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:29:50.344+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912190:344523][25582:0x7f0f69c53c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:29:50.344+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:29:50.354+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0f68b83635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0F68B62000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE1571000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0F6983A000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0F69636000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0F6933C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0F69127000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0F68F0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0F68B62000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0F69A43000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0f68b83635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:29:50.355+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:30:49.473+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] MongoDB starting : pid=25802 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:30:49.481+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:30:49.531+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:30:49.902+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912249:902820][25802:0x7fe2fb028c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:30:49.902+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:30:49.923+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe2f9f58635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE2F9F37000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4561E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE2FAC0F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE2FAA0B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE2FA711000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE2FA4FC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE2FA2DF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE2F9F37000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE2FAE18000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe2f9f58635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:30:49.923+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:31:49.321+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:31:49.328+0000 I CONTROL [initandlisten] MongoDB starting : pid=26032 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:31:49.329+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:31:49.378+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:31:49.806+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912309:806071][26032:0x7f617e485c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:31:49.806+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:31:49.826+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f617d3b5635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F617D394000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14F46000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F617E06C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F617DE68000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F617DB6E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F617D959000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F617D73C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F617D394000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F617E275000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f617d3b5635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:31:49.826+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:32:49.956+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] MongoDB starting : pid=26160 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:32:49.963+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:32:50.016+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:32:50.333+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912370:333088][26160:0x7fec81d01c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:32:50.333+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:32:50.346+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fec80c31635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FEC80C10000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC4CEC000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FEC818E8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEC816E4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEC813EA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEC811D5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEC80FB8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEC80C10000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEC81AF1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fec80c31635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:32:50.346+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:33:49.467+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:33:49.474+0000 I CONTROL [initandlisten] MongoDB starting : pid=26622 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:33:49.474+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:33:49.474+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:33:49.474+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:33:49.474+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:33:49.474+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:33:49.475+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:33:49.475+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:33:49.475+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:33:49.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:33:49.882+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912429:882637][26622:0x7f481351cc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:33:49.882+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:33:49.893+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f481244c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F481242B000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01EFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4813103000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4812EFF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4812C05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F48129F0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F48127D3000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F481242B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F481330C000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f481244c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:33:49.893+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:34:49.186+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] MongoDB starting : pid=27125 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:34:49.193+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:34:49.243+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:34:49.515+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912489:515439][27125:0x7f33d4d8ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:34:49.515+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:34:49.526+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f33d3cba635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F33D3C99000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF744FA000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F33D4971000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F33D476D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F33D4473000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F33D425E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F33D4041000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F33D3C99000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F33D4B7A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f33d3cba635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:34:49.526+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:35:49.529+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] MongoDB starting : pid=27627 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:35:49.538+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:35:49.588+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:35:49.963+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912549:963855][27627:0x7fc8b826fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:35:49.963+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:35:49.982+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc8b719f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC8B717E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2FAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC8B7E56000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC8B7C52000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC8B7958000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC8B7743000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC8B7526000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC8B717E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC8B805F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc8b719f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:35:49.983+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:36:49.435+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:36:49.442+0000 I CONTROL [initandlisten] MongoDB starting : pid=27907 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:36:49.442+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:36:49.442+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:36:49.442+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:36:49.442+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:36:49.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:36:49.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:36:49.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:36:49.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:36:49.499+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:36:49.847+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912609:847555][27907:0x7f630ce29c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:36:49.847+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:36:49.858+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f630bd5b635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F630BD3A000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7F630D73A000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F630CA12000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F630C80E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F630C514000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F630C2FF000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F630C0E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F630BD3A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F630CC1B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f630bd5b635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:36:49.858+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:37:49.995+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] MongoDB starting : pid=28057 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:37:50.002+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:37:50.053+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:37:50.371+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912670:371673][28057:0x7f4382c06c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:37:50.371+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:37:50.395+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4381b36635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4381B15000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF821E2000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F43827ED000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F43825E9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F43822EF000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F43820DA000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4381EBD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4381B15000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F43829F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4381b36635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:37:50.395+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:38:49.526+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] MongoDB starting : pid=28379 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:38:49.534+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:38:49.587+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:38:49.964+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912729:964703][28379:0x7f928f09ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:38:49.964+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:38:49.984+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f928dfce635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F928DFAD000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6AAFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F928EC85000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F928EA81000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F928E787000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F928E572000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F928E355000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F928DFAD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F928EE8E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f928dfce635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:38:49.984+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:39:49.146+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] MongoDB starting : pid=28628 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:39:49.153+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:39:49.204+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:39:49.554+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912789:554971][28628:0x7fccaa4f8c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:39:49.555+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:39:49.574+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fcca9428635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FCCA9407000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF920FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FCCAA0DF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FCCA9EDB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FCCA9BE1000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FCCA99CC000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FCCA97AF000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FCCA9407000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FCCAA2E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fcca9428635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:39:49.574+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:40:49.706+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] MongoDB starting : pid=28882 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:40:49.714+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:40:49.764+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:40:50.066+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912850:66417][28882:0x7f824575dc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:40:50.066+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:40:50.076+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f824468d635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F824466C000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE2CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8245344000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8245140000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8244E46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8244C31000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8244A14000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F824466C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F824554D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f824468d635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:40:50.076+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:41:49.556+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:41:49.563+0000 I CONTROL [initandlisten] MongoDB starting : pid=29107 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:41:49.564+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:41:49.613+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:41:49.999+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912909:999119][29107:0x7f0d05b8ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:41:49.999+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:41:50.025+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d04abe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D04A9D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF85BC8000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D05775000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D05571000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D05277000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D05062000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D04E45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D04A9D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D0597E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d04abe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:41:50.025+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:42:49.156+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] MongoDB starting : pid=29251 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:42:49.164+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:42:49.218+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:42:49.555+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507912969:555355][29251:0x7fe196497c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:42:49.555+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:42:49.568+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fe1953c7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FE1953A6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB8CFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FE19607E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FE195E7A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FE195B80000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FE19596B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FE19574E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FE1953A6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FE196287000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fe1953c7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:42:49.568+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:43:49.722+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:43:49.729+0000 I CONTROL [initandlisten] MongoDB starting : pid=29696 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:43:49.729+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:43:49.729+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:43:49.729+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:43:49.729+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:43:49.730+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:43:49.730+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:43:49.730+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:43:49.730+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:43:49.781+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:43:50.150+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913030:150478][29696:0x7f9c99731c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:43:50.150+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:43:50.172+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9c98661635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9C98640000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF28AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9C99318000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9C99114000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9C98E1A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9C98C05000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9C989E8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9C98640000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9C99521000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9c98661635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:43:50.172+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:44:49.466+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:44:49.473+0000 I CONTROL [initandlisten] MongoDB starting : pid=29928 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:44:49.474+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:44:49.523+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:44:49.817+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913089:817904][29928:0x7fdb5dfc7c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:44:49.817+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:44:49.837+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fdb5cef7635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDB5CED6000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB53A3000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDB5DBAE000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDB5D9AA000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDB5D6B0000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDB5D49B000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDB5D27E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDB5CED6000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDB5DDB7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fdb5cef7635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:44:49.837+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:45:49.975+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] MongoDB starting : pid=30233 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:45:49.983+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:45:50.035+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:45:50.367+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913150:367965][30233:0x7f1cb4066c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:45:50.368+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:45:50.378+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1cb2f96635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1CB2F75000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF35990000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1CB3C4D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1CB3A49000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1CB374F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1CB353A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1CB331D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1CB2F75000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1CB3E56000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1cb2f96635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:45:50.378+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:46:49.819+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] MongoDB starting : pid=30465 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:46:49.827+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:46:49.877+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:46:50.215+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913210:215872][30465:0x7f8443c6ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:46:50.215+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:46:50.226+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8442b9e635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8442B7D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8443855000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8443651000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8443357000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8443142000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8442F25000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8442B7D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8443A5E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8442b9e635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:46:50.226+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:47:49.366+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] MongoDB starting : pid=30593 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:47:49.373+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:47:49.434+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:47:49.705+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913269:705667][30593:0x7f6d22edcc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:47:49.705+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:47:49.716+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f6d21e0c635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F6D21DEB000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF4EA3E000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F6D22AC3000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6D228BF000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6D225C5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6D223B0000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6D22193000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6D21DEB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6D22CCC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f6d21e0c635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:47:49.716+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:48:49.862+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:48:49.869+0000 I CONTROL [initandlisten] MongoDB starting : pid=30902 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:48:49.869+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:48:49.870+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:48:49.920+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:48:50.210+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913330:210603][30902:0x7fde1b050c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:48:50.210+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:48:50.221+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fde19f80635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FDE19F5F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF8E2FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FDE1AC37000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDE1AA33000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDE1A739000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDE1A524000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDE1A307000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDE19F5F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDE1AE40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fde19f80635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:48:50.221+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:49:49.350+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] MongoDB starting : pid=31116 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:49:49.358+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:49:49.411+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:49:49.743+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913389:743092][31116:0x7f0d5145ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:49:49.743+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:49:49.753+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f0d5038a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F0D50369000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF272FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F0D51041000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F0D50E3D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F0D50B43000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F0D5092E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0D50711000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0D50369000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F0D5124A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f0d5038a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:49:49.753+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:50:49.098+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] MongoDB starting : pid=31361 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:50:49.105+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:50:49.154+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:50:49.438+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913449:438631][31361:0x7fc4fce5fc80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:50:49.438+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:50:49.450+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7fc4fbd8f635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7FC4FBD6E000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF24AFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7FC4FCA46000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC4FC842000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC4FC548000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC4FC333000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC4FC116000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC4FBD6E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC4FCC4F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7fc4fbd8f635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:50:49.450+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:51:49.466+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] MongoDB starting : pid=31865 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:51:49.477+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:51:49.529+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:51:49.820+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913509:820731][31865:0x7f8d55ba9c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:51:49.820+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:51:49.831+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8d54ad9635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8D54AB8000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF67032000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8D55790000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D5558C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D55292000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D5507D000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D54E60000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D54AB8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D55999000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8d54ad9635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:51:49.831+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:52:49.958+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] MongoDB starting : pid=32134 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:52:49.966+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:52:50.016+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:52:50.326+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913570:326270][32134:0x7f1b9f746c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:52:50.326+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:52:50.336+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b9e676635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B9E655000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF342FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B9F32D000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B9F129000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B9EE2F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B9EC1A000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B9E9FD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B9E655000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B9F536000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b9e676635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:52:50.336+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:53:49.457+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] MongoDB starting : pid=32435 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:53:49.465+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:53:49.515+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:53:49.922+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913629:922254][32435:0x7f1b962a0c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:53:49.922+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:53:49.941+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f1b951d0635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F1B951AF000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF976FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F1B95E87000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1B95C83000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1B95989000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1B95774000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1B95557000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1B951AF000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1B96090000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f1b951d0635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:53:49.942+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:54:49.074+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] MongoDB starting : pid=32569 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:54:49.081+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:54:49.134+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:54:49.561+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913689:561691][32569:0x7eff63bc3c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:54:49.561+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:54:49.581+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7eff62af3635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7EFF62AD2000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC88FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7EFF637AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF635A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF632AC000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF63097000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF62E7A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF62AD2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF639B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7eff62af3635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:54:49.581+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:55:49.519+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] MongoDB starting : pid=360 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:55:49.527+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:55:49.578+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:55:49.885+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913749:884986][360:0x7f824cb8ec80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:55:49.885+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:55:49.904+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f824babe635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F824BA9D000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF14176000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F824C775000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F824C571000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F824C277000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F824C062000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F824BE45000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F824BA9D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F824C97E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f824babe635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:55:49.904+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:56:49.364+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:56:49.370+0000 I CONTROL [initandlisten] MongoDB starting : pid=881 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:56:49.370+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:56:49.371+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:56:49.421+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:56:49.683+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913809:683088][881:0x7f8045d3ac80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:56:49.683+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:56:49.694+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f8044c6a635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F8044C49000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF266FE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F8045921000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F804571D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8045423000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F804520E000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8044FF1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8044C49000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8045B2A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f8044c6a635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:56:49.694+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:57:49.814+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] MongoDB starting : pid=6042 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:57:49.821+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:57:49.871+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:57:50.155+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913870:155509][6042:0x7f4e2aaf1c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:57:50.155+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:57:50.165+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4e29a21635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F4E29A00000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE1487000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F4E2A6D8000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F4E2A4D4000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4E2A1DA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4E29FC5000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4E29DA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F4E29A00000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4E2A8E1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4e29a21635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:57:50.166+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:58:49.124+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] MongoDB starting : pid=6666 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:58:49.133+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:58:49.184+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:58:49.503+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913929:503364][6666:0x7f9a2ac65c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:58:49.503+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:58:49.522+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f9a29b95635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F9A29B74000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAEEDB000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F9A2A84C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9A2A648000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9A2A34E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9A2A139000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9A29F1C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9A29B74000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9A2AA55000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f9a29b95635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:58:49.522+0000 I - [initandlisten] ***aborting after invariant() failure 2017-10-13T16:59:49.436+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] MongoDB starting : pid=7489 port=27017 dbpath=/var/opt/lamplighter/data 64-bit host=sojo-cfmcv-01.provocraft.com 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] db version v3.2.12 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] git version: ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] allocator: tcmalloc 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] modules: none 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] build environment: 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] distarch: x86_64 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] target_arch: x86_64 2017-10-13T16:59:49.443+0000 I CONTROL [initandlisten] options: { config: "/var/opt/lamplighter/etc/mongod.conf", storage: { dbPath: "/var/opt/lamplighter/data", engine: "wiredTiger", wiredTiger: { engineConfig: { configString: "cache_size=1536M" } } }, systemLog: { component: { accessControl: { verbosity: 0 }, command: { verbosity: 0 } }, destination: "file", logAppend: true, logRotate: "reopen", path: "/var/opt/lamplighter/log/mongodb.log", timeStampFormat: "iso8601-local", traceAllExceptions: false, verbosity: 0 } } 2017-10-13T16:59:49.495+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),cache_size=1536M 2017-10-13T16:59:49.741+0000 E STORAGE [initandlisten] WiredTiger (-31802) [1507913989:740996][7489:0x7f4165a00c80], file:collection-40--8734011645000920999.wt, WT_SESSION.open_cursor: unable to read root page from file:collection-40--8734011645000920999.wt: WT_ERROR: non-specific WiredTiger error 2017-10-13T16:59:49.741+0000 I - [initandlisten] Invariant failure: ret resulted in status UnknownError: -31802: WT_ERROR: non-specific WiredTiger error at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 79 2017-10-13T16:59:49.751+0000 I CONTROL [initandlisten] 0x130ff72 0x12bae28 0x12a314d 0x108d304 0x108bc00 0x1087c22 0x108662d 0x10771db 0xfd66d4 0xfdc472 0x1075a58 0xf996e8 0x95a91e 0x95cec0 0x9600cd 0x7f4164930635 0x9572d9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0FF72","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EBAE28","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EA314D","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"C8D304","s":"_ZN5mongo17WiredTigerSession9getCursorERKSsmb"},{"b":"400000","o":"C8BC00","s":"_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE"},{"b":"400000","o":"C87C22","s":"_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b"},{"b":"400000","o":"C8662D","s":"_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE"},{"b":"400000","o":"C771DB","s":"_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE"},{"b":"400000","o":"BD66D4","s":"_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb"},{"b":"400000","o":"BDC472","s":"_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE"},{"b":"400000","o":"C75A58"},{"b":"400000","o":"B996E8","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"55A91E"},{"b":"400000","o":"55CEC0","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"5600CD","s":"main"},{"b":"7F416490F000","o":"21635","s":"__libc_start_main"},{"b":"400000","o":"5572D9"}],"processInfo":{ "mongodbVersion" : "3.2.12", "gitVersion" : "ef3e1bc78e997f0d9f22f45aeb1d8e3b6ac14a14", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.53sf.virtual-150", "version" : "#1 SMP Thu Aug 31 19:10:36 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEEEFE000", "path" : "linux-vdso.so.1", "elfType" : 3 }, { "b" : "7F41655E7000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F41653E3000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F41650E9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4164ED4000", "path" : "/usr/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4164CB7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F416490F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41657F0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130ff72] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12bae28] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12a314d] mongod(_ZN5mongo17WiredTigerSession9getCursorERKSsmb+0xE4) [0x108d304] mongod(_ZN5mongo16WiredTigerCursorC1ERKSsmbPNS_16OperationContextE+0x50) [0x108bc00] mongod(_ZN5mongo21WiredTigerRecordStore6CursorC1EPNS_16OperationContextERKS0_b+0x92) [0x1087c22] mongod(_ZN5mongo21WiredTigerRecordStoreC1EPNS_16OperationContextENS_10StringDataES3_SsbbllPNS_14CappedCallbackEPNS_20WiredTigerSizeStorerE+0x3ED) [0x108662d] mongod(_ZN5mongo18WiredTigerKVEngine14getRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsE+0x1AB) [0x10771db] mongod(_ZN5mongo22KVDatabaseCatalogEntry14initCollectionEPNS_16OperationContextERKSsb+0x204) [0xfd66d4] mongod(_ZN5mongo15KVStorageEngineC1EPNS_8KVEngineERKNS_22KVStorageEngineOptionsE+0x6D2) [0xfdc472] mongod(+0xC75A58) [0x1075a58] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf996e8] mongod(+0x55A91E) [0x95a91e] mongod(_ZN5mongo13initAndListenEi+0x10) [0x95cec0] mongod(main+0x15D) [0x9600cd] libc.so.6(__libc_start_main+0xF5) [0x7f4164930635] mongod(+0x5572D9) [0x9572d9] ----- END BACKTRACE ----- 2017-10-13T16:59:49.751+0000 I - [initandlisten] ***aborting after invariant() failure